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ABSTRACT 


The  activities  of  the  Psychometrics  Department  of  TRACOR, 
Inc.,  under  Contract  No.  F  19628-70-C-0182  fall  into  two  major 
categories.  In  the  first  category  are  research  activities 
undertaken  with  the  aim  of  developing  improved  methods  for 
evaluating  voice  communication  systems  and  devices.  In  the 
second  category  are  testing  services  performed  with  processed 
speech  materials  supplied  by  the  contract  monitor. 

The  research  activities  included  five  major  research  pro¬ 
jects  from  which  technical  papers  resulted.  They  are: 

"Diagnostic  Approach  to  the  Evaluation  of  Speech  Intelli¬ 
gibility" 

"The  Nature  of  Individual  Differences  in  Diagnostic  Rhyme 
Test  Performance" 

"Speaker  Effects  on  Intelligibility  Test  Results" 

"Structure  of  Phonemic  Information  in  the  Oral  and  Nasal 
Outputs" 

"Diagnostic  Evaluation  of  Intelligibility  of  Present-Day 
Digital  Vocoders"  (jointly  authored  by  W.  D.  Voiers  and 
C.  P.  Smith) 

These  papers  constitute  Chapters  1-5  of  this  report.  A  summary 
of  activities  constitutes  Chapter  6.  The  results  of  diagnostic 
Intelligibility  tests  were  forwarded  to  the  contract  monitor  as 
they  became  available  during  the  period  of  the  contract. 
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CHAPTER  1 


DIAGNOSTIC  APPROACH  TO  THE  EVALUATION 
OF  SPEECH  INTELLIGIBILITY 

by 


William  D.  Voters 


PREFACE 


During  the  three  years  in  which  the  Diagnostic  Rhyme  Test 
Form  III  was  used  for  purposes  of  research  and  system  evaluation, 
a  mass  of  data  bearing  upon  the  intrinsic  difficulty  of  indivi¬ 
dual  test  items  was  accumulated.  Examination  of  these  data 
revealed  various  indications  that  variation  in  difficulty  among 
items  of  a  given  type  is,  at  least  in  part,  of  systematic  origin. 

There  were  several  indications  that  item  difficulty 
varies  with  vowel  context.  More  pronounced,  however,  were  indi¬ 
cations  that  the  apprehensibility  of  a  given  feature  varies  with 
the  states  of  other  features  in  the  same  phoneme.  This  phenonienon 
is  termed  an  ipsative  dependency  to  distinguish  it  from  the  types 
of  transitive  dependencies  usually  referred  to  a?  coarticulation 
effects.  For  example,  of  the  items  designed  to  test  for  the 
apprehensibility  of  voicing,  those  items  in  which  the  critical 
phonemes  are  sustained  (e.g. ,  /v/  and  /f/)  appeared  to  be  more 
difficult  generally  than  items  in  which  the  critical  phonemes  are 
interrupted  (e.g.,  /b/  and  /p/).  Among  the  items  designed  to  test 
the  apprehensibility  of  graveness,  items  which  involved  unvoiced 
critical  phoneme  pairs  appeared  under  some  conditions  (e.g., 
noise-masked  and  low  passed  speech)  to  be  more  difficult  than 
items  involving  voiced  pairs.  The  reverse  of  this  trend  was 
observed,  however,  in  the  case  of  high  passed  speech,  and  there 
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were  other  instances  of  dependencies  which  appeared  to  be  inter¬ 
active  with  the  transmission  condition  involved. 

Such  dependencies  are  clearly  of  potential  diagnostic  signi¬ 
ficance,  but  while  they  can  be  detected  with  Form  III  of  the  DRT, 
their  evaluation  is,  in  most  instances,  a  rather  cumbersome  pro¬ 
cess.  It  was  clearly  desirable,  therefore,  to  design  a  test, 
the  structure  of  whichwould  permit  relatively  rigorous  statis¬ 
tical  evaluation  of  both  ipsative  and  transitive  dependencies. 
Accordingly,  modification  of  the  DRT  was  undertaken  to  the  end 
of  providing  a  test  in  which  various  dependencies  of  both  types 
would  be  amenable  to  routine  statistical  evaluation.  The  culmin¬ 
ation  of  this  effort  was  Diagnostic  Rhyme  Test  Form  IV  (DRT  IV), 
which  is  described  in  the  following  report. 


INTRODUCTION 


It  is  a  matter  of  common  observation  that  speech  communica¬ 
tion  --  more  specifically,  a  listener's  apprehension  of  a 
speaker's  linguistic  Intent  --  is  essentially  a  dual  process. 

One  aspect  of  this  process,  the  perceptual  aspect,  involves 
discriminations  by  the  listener  of  various  acoustical  manifesta¬ 
tions  of  the  speaker's  intent.  The  other,  apperceptual ,  aspect 
involves  inferences  based  on  contextual  or  extra-stimulus  infor¬ 
mation,  i.e.,  on  information  from  sources  extrinsic  to  the  in;me- 
diate  acoustical  correlates  of  the  speaker's  intent.  Thus  the 
listener's  uncertainty  with  regard  to  a  speaker's  intent  may  he 
reduced  by  such  factors  as  his  knowledge  of  the  structure  of  the 
language  involved;'’^  his  knowledge  of  the  circumstances  occasion- 
ing  and  the  purposes  motivating  the  communication;  his  familiar¬ 
ity  with  dialectal  and  idlolectal  characteristics  of  the  speaker;' 
and  his  knowledge  of  the  immediate  past  history  of  the  speech 
signal . " 

Both  the  perceptual  and  the  apperceptual  aspects  of  the 
speech  apprehension  process  are  legitimate  subjects  of  scientific 
interest.  For  most  scientific  purposes,  however,  it  is  essential 
that  they  be  subject  to  independent  experimental  control.  Clearly, 
it  is  essential  that  contextual  effects  be  controlled  in  listening 
tests  conducted  to  evaluate  the  intrinsic  characteristics  of  a 
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transmission  channel  or  medium  as  well  as  in  experiments  concerned 
with  certain  aspects  oi  the  processes  of  speech  production  and 
perception.  To  the  extent  that  a  listener's  responses  in  the 
testing  situation  are  dependent  to  an  unknown  degree  upon  con¬ 
textual  information,  his  performance  necessarily  provides  an  im¬ 
perfect  reflection  of  the  entity  or  process  under  evaluation. 
Although  cognizance  of  this  issue  is  at  least  implicit  in  the 
designs  of  most  speech  reception  tests  in  use  today,  a  number  of 
problems  remain.  These  problems  become  particularly  acute,  more¬ 
over,  in  those  instances  where  some  form  of  "diagnostic"  scoring 
is  to  be  attempted,  i.e.,  where  significance  is  to  be  attributed 
not  only  to  the  number,  but  also  to  the  types  of  errors  committed 
by  the  listener. 

Among  the  more  formidable  problems  complicating  the  design 
and  use  of  speech  reception  tests  is  the  problem  of  controlling 
the  effects  of  the  listener's  familiarity  with  the  test  material^ 
used,  and  a  variety  of  procedures  have  been  devised  to  cope  with 
it.  In  the  case  of  the  Harvard  Phonetically  Balanced  (PB)  Test, 
for  example,  the  recommended  procedure  for  controlling  familiarity 
involves  an  extensive  regimen  of  training,  terminated  on  evidence 
that  the  effects  of  familiarity  have  reached  an  asymptotic  state. ^ 
This  approach  to  the  problem  serves,  among  other  things,  to  limit 
the  circumstances  in  which  use  of  the  "PB"  test  is  practical. 

More  crucial,  however,  are  its  potential  effects  on  the  validity 
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of  results  obtained  with  the  test. 

Familiarization  training  serves  most  immediately  to  alter  the 
general  level  of  difficulty  of  the  listener's  task,  and  thus  to 
obscure  any  relationship  between  the  "real  world"  and  the  testing 
situation  that  might  be  claimed  on  the  basis  of  absolute  level  of 
difficulty.  Additionally,  however,  familiarization  training  may 
effect  qualitative  changes  in  the  listener's  task  and  thus  in  the 
implications  of  his  performance.  This  possibility  derives  fron 
the  fact  that  the  various  discriminations  required  of  the  listen¬ 
er  in  the  course  of  recognizing  a  speech  sound  are  not  of  intrin- 
sirally  equal  difficulty.  As  shown  by  Miller  and  Nicely,  for 
example,  some  discriminations  are  accomplished  with  virtually 
perfect  reliability,  even  under  conditions  of  extreme  signal  im¬ 
poverishment.  Others  are  accomplished  with  significantly  less 
than  perfect  reliability  under  the  best  of  conditions,  and  may 
become  prohibitively  difficult  under  conditions  of  signal  impover¬ 
ishment.  In  view  of  these  considerations,  it  would  seem  to  be  an 
extremely  tenuous  assumption  that  the  facilitative  effects  of 
familiarization  training  are  exerted  equally  on  all  aspects  of 
the  speech  discrimination  task.  The  alternative  possibility  is 
:hat  familiarization  training  facilitates  listener  performance 
primarily  in  the  more  difficult  aspects  of  the  speech  discrimina¬ 
tion  task.  Effectively,  therefore,  it  may  desensitize  the  test 
primarily  with  respect  to  the  acoustic  speech  features  most  cru¬ 
cial  to  the  communication  process  and,  perhaps,  most  vulnerable 
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to  common  forms  of  signal  impoverishment.  In  any  case,  the  Inter- 
phonemlc  constraints  characteristic  of  the  "PB"  and  similar  word 
recognition  tests  preclude  any  type  of  qualitative  or  "diagnostic" 
evaluation  of  listener  errors.  Such  constraints  hopelessly  con¬ 
found  the  effects  of  contextual  factors  with  effects  attributable 
to  the  characteristics  of  the  entity  under  test. 

Testing  procedures  in  which  stimulus  uncertainty  Is  limited 
to  a  single  phoneme  (as  In  the  Fairbanks  Rhyme  Test**),  and  parti¬ 
cularly  where  the  listener's  response  options  are  explicitly 

specified  (as  In  the  Modified  Rhyme  Test  *  and  the  Phonemlcally 

10 

Balanced  Rhyme  Test  ),  substantially  reduce  the  effects  of 
familiarity  upon  listener  performance.  However,  restriction  of 
the  listener's  reponse  options,  whether  Implicit  or  explicit,  may 
complicate  the  Interpretation  of  test  results  In  other  ways, 
particularly  If  significance  Is  to  be  attributed  to  the  type  as 
well  as  to  the  number  of  errors  committed  by  the  listener.  To 
restrict  the  listener's  response  options  in  an  arbitrary  or  unsys¬ 
tematic  manner  may  be  to  substitute  one  set  of  unknown  contextual 
constraints  for  another,  such  that  stimulus  effects  upon  the  type 
of  error  committed  become  confounded  with  contextual  effects. 

The  crucial  point  here  Is  that  the  discriminations  required  of  a 
listener  In  Identifying  a  complex  stimulus  are  determined  not  by 
the  characteristics  of  the  stimulus  as  regarded  In  Isolation,  but 
rather  by  the  characteristics  that  distinguish  the  stimulus  from 
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what  the  listener  conceives  to  be  the  set  of  possible  stinuli  In 
a  given  Instance.  Thus,  to  constrain  the  listener's  options  In 
an  unsystematic  manner  is  possibly  to  deny  hin'  opportunities  for 
providing  information  concerning  the  dlscrlmlnablllty  of  certain 
speech  features.  This,  In  turn,  may  serve  to  desensitize  a 
speech  reception  test  with  respect  to  specific  deficiencies  of 
the  communication  system,  speaker,  or  listener  being  tested. 

The  hazards  of  restricted  response  sets  can  be  minimized  by 
means  of  carefully  designed  test  items,  particularly  where  the 
differences  between  the  correct  and  incorrect  response  options  are 
in  some  sense  univocal.  For  example,  in  the  ensemble; 

bee  pea  vee  dee  me , 
each  permissible,  erroneous  response  differs  from  the  correct 
response,  "bee,"  by  a  single  "distinctive  feature."  Tests  composed 
of  such  items  could  be  quite  effective  in  circumstances  where  the 
individual  listener  does  not  experience  repeated  exposure  to  the 
test  materials. 

Problems  arise,  however,  where  it  is  desirable  to  have  differ¬ 
ent,  but  equivalent  randomizations  of  multiple  choice  test  mater¬ 
ials.  If,  for  example,  "pea"  were  the  stimulus  word  in  the  above 
ensemble,  "unidimensional"  differences  between  correct  and  in¬ 
correct  options  would  no  longer  obtain.  Only  "bee"  differs  nini- 
mally  and  unidimensional ly  from  the  stimulus  word,  while  other 
options  differ  by  two  or  more  "distinctive  features."  The  struc- 
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ture  of  a  test  compoaed  of  such  Items  would  thus  tend  to  vary 
somewhat  with  different  randomizations  of  the  test  materials  and 
to  greatly  complicate  the  mechanics  of  both  gross  and  diagnostic 
scoring. 

From  the  foregoing  it  is  evident  that  the  multiple  choice 
approach,  in  general,  has  certain  limitations  as  well  as  intrin> 
sic  advantages.  Many  of  these  limitations  can  be  overcome  by 
recourse  to  the  special  case  of  two-choice  testing  procedures. 

With  such  procedures,  erroneous  responses  can,  but  for  the  effects 
of  chance,  be  attributed  unequivocally  to  the  characteristics  of 
the  entity  under  test.  Because  of  the  inherent  redundancy  of 
the  speech  signal,  however,  phonemic  confusion  data  do  not  ordin¬ 
arily  suffice  for  exact  specification  of  deficiencies  of  the 
system  or  other  entity  under  test.  Rather,  a  phonemic  confusion 
implies  a  deficiency  in  the  encoding,  transmission  or  discrimina¬ 
tion  of  one  or  more  acoustical  speech  features,  the  precise  num¬ 
ber  and  nature  of  which  cannot  be  specified  without  additional 
information. 

Given  this  circumstance,  it  is  clearly  desirable  at  least  to 
minimize  uncertainty  as  to  the  feature  or  features  involved. 

The  means  to  this  end  is  provided  by  a  phonemic  taxonomy  broadly 
patterned  after  the  distinctive  feature  systems  of  Jacobson,  Fant 
and  Halle, “  Miller  and  Nicely,'*  and  De  Lattre.'*  Such  a  taxo¬ 
nomy  provides  a  basis  for  the  construction  of  a  two-choice  test 
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where  the  correctness  of  the  listener's  response  to  a  given  item 
is  criterial  -•  depending  on  the  design  and  purposes  of  the  in¬ 
vestigation  --of  the  effective  fidelity  with  which  a  speaker 
articulates,  a  system  transmits,  or  the  listener  himself  can  dis¬ 
criminate  the  states  of  a  limited  set,  or  cluster .  of  inter- 
correlated,  information-bearing,  acoustical  features.  Data 
yielded  by  such  a  test  can  serve  to  sharply  delimit  the  possible 
sources  of  deficiency  or  malfunction  in  an  entity  under  test,  and 
may  serve  in  conjunction  with  other  information  to  identify,  pre¬ 
cisely,  source  of  malfunction  or  deficiency. 

The  Diagnostic  Rhyme  Test  (DRT),  in  all  of  its  versions,  was 
designed  on  the  basis  of  the  foregoing  considerations.  According¬ 
ly,  it  is  a  two-choice  test  in  which  each  item  Involves  two 
rhyming  words,  the  initial  consonants  of  which  differ  by  a  single 
phonemic  attribute  or  feature.  The  listener's  task  is  simply  to 
Judge  which  of  the  two  words  has  been  spoken,  indicating,  in 
effect,  that  he  has  or  has  not  apprehended  the  speaker's  intent 
with  respect  to  the  state  of  a  particular  phonemic  attribute. 

In  addition  to  the  theoretical  advantages  that  can  be  realized 
with  a  two-choice  approach,  there  are  some  significant  practical 
advantages.  Among  them  are:  (1.)  economy  of  testing  time  and 
materials,  in  that  the  use  of  minimally  contrasting  word  pairs 
serves  to  exclude  excessively  easy  and,  hence,  effectively  non¬ 
functional  items;  (2.)  minimal  requirements  with  regard  to  lis- 
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tener  selection  and  training  (previous  experience  with  the  test 
materials  can  serve  to  facilitate  listener  performance  only  with 
respect  to  a  particular  randomization  of  the  test  materials); 

(3.)  adaptability  to  both  manual  and  computer  scoring  schemes; 

(4.)  ease  with  which  structurally  equivalent  randomizations  can 
be  generated. 

Table  1  presents  the  phonemic  taxonomy  used  as  a  basis  for 
the  design  of  the  DRT,  In  which  the  six  dimensions:  voicing, 
nasality,  sustention,  sibilation,  graveness .  and  compactness 
are  represented.  No  provision  Is  made  to  test  apprehensibility 
of  "vowel  likeness,"  but  constraints  are  observed  in  item  con¬ 
struction  to  prevent  covariation  of  this  attribute  with  any  of  the 
above . 

The  articulatory  and  acoustical  correlates  of  the  phonemic 

attributes  (or  their  equivalents  In  other  classification  systems) 

with  which  the  DRT  Is  concerned  are  extensively  described  In  the 

u 

recent  literature.  Only  the  more  Important  of  these  are  Indi¬ 
cated  in  Table  2.  In  accordance  with  the  principle  that  consonant 
phonemes  carry  the  bulk  of  the  useful  Information  In  speech,  and 
are  also  most  susceptible  to  degradation,  the  scope  of  the  DRT, 
like  the  Fairbanks  Rhyme  Test  and  its  derivatives,  is  concerned 
only  with  the  apprehensibility  of  consonants.  Also  like  the  FRT, 
the  DRT  treats  only  the  case  of  consonant  apprehension  In  the 
Initial  position.  Although  It  Is  recognized  that  consonants  may 


TABLE  1.  Consonant  Taxonomy  Used  in  the  Construction  of  the  DRT  (Form  IV). 
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Absent  Anterior  or  medial  articulation.  Second  and  third  formants  con 

vergent  or  parallel. 
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be  differentially  perceptible  in  the  initial,  intervocalic  and 
terminal  positions,  the  features  involved  are  assumed  to  be 
equally  represented  in  all  positions. 


THE  DIAGNOSTIC  RHYME  TEST  (DRT) 


Structure  of  th«  DRT 

The  Diagnostic  Rhyme  Test  (DRT)  is  more  properly  described 
in  terms  of  a  set  of  principles  for  item  construction  and  selec¬ 
tion  than  in  terms  of  a  specific  corpus  of  test  materials.  Thus, 
the  corpus  of  96  rhyming  word  pairs  shown  in  Table  3  constitutes 
only  one  realization  of  such  principles,  but  takes  into  account 
the  results  of  various  experimental  investigations  conducted  with 
earlier  versions  of  the  DRT.  The  gross  structure  of  the  test  is 
evident  in  the  table,  where  the  items  in  each  block  of  seven  are 
arranged  according  to  the  attribute  involved.  The  order  is  as 
follows : 

1.  Voicing 

2.  Nasality 

3.  Sustention 

4.  Sibilation 

5.  Graveness 

6 .  Compactness 

7.  Filler  item  (to  be  used  for  research 

purposes,  etc.) 

The  positive  state  (e.g.,  grave)  of  each  attribute  is  repre¬ 
sented  in  the  left  member  of  each  pair;  the  negative  state  (e.g., 
acute)  is  represented  in  the  right  member  of  each  pair. 


The  apprehensibility  of  each  attribute  is  tested  in  each  of 
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TABLE  3.  Speech  Materials  Used  in  Form  IV  of  the  Diagnostic  Rhyme  Test. 


99.* 

VEAL- FEEL 

107. 

MEAT- BEAT 

59. 

VEE-BEE 

67. 

ZEE -THEE 

19. 

WEED-REED 

27.  ' 

yiELD-WIELD 

35.** 

71. 

GIN-CHIN 

79. 

MITT -BIT 

31. 

VILL-BILL 

95. 

JILT-GILT 

47. 

BID-DID 

55. 

HIT-FIT 

7 .  ** 

8. 

ZED-SAID 

72. 

MEND -BEND 

80. 

THEN-DEN 

32. 

JEST-GUEST 

40. 

MET-NET 

104. 

KEG -PEG 

56.** 

36. 

VAST-FAST 

44. 

MAD -BAD 

52. 

THAN-DAN 

4. 

JAB-GAB 

12. 

BANK-DANK 

76. 

GAT- BAT 

84.** 

43 .  BEAN-PEEN 
51 .  NEED-DEED 
3 .  SHEET-CHEAT 
11.  CHEEP -KEEP 
75.  PEAK-TEAK 
83 .  KEY-TEA 
91.**  . 


15.  DINT-TINT 
23.  NIP-DIP 

87.  THICK-TICK 
39.  SING-THING 
103 .  FIN-THIN 

111.  GILL-DILL 
63.**  . 


64.  DENSE -TENSE 
16.  NECK-DECK 
24 .  FENCE-PENCE 
88.  CHAIR-CARE 
96 .  PENT-TENT 

48.  YEN-WREN 

112.**  . 


92. 

GAFF -CALF 

100. 

NAB -DAB 

108. 

SHAD-CHAD 

60. 

SANK-THANK 

68. 

FAD-THAD 

20. 

SHAG-SAG 

28.** 

50.  ZOO-SUE 

2.  MOOT- BOOT 
66.  FOO-POOH 

74.  JUICE -GOOSE 
82 .  MOON-NOON 
34.  COOP -POOP 
98.**  . 


22. 

VOLE -FOAL 

30. 

MOAN-BONE 

38. 

THOSE -DOZE 

46. 

JOE -GO 

110. 

BOWL-DOLE 

6. 

GHOST-BOAS' 

70.** 


85.  JOCK-CHOCK 
93.  MOM- BOMB 

101.  VON-BON 

109.  JOT -GOT 

61.  WAD-ROD 

69.  HOP -FOP 

21.**  . 


106.  DUNE -TUNE 

58.  NEWS -DUES 

10.  SHOES -CHOOSE 
18.  CHEW-COO 
26.  POOL-TOOL 
90.  YOU-RUE 
42 . **  . 


78.  GOAT -COAT 
86.  NOTE -DOTE 
94.  THOUGH -DOUGH 
102.  SOLE -THOLE 

54.  FORE -THOR 
62 .  SHOW-SO 

14 .  **  _ 


29. 

BOND -POND 

37. 

KNOCK-DOCK 

45. 

VOX -BOX 

53. 

CHOP -COP 

5. 

POT -TOT 

13. 

GOT-DOT 

77.** 


57. 

VAULT-FAULT 

1. 

DAUNT -TAUNT 

65. 

MOSS-BOSS 

9. 

GNAW-DAW 

17. 

THONG -TONG 

73. 

SHAW-CHAW 

81. 

JAWS -GAUZE 

25. 

SAW-THAW 

33. 

FOUGHT-THOUGHT 

89. 

BONG -DONG 

97. 

YAWL-WALL 

41. 

CAUGHT -TAUGHT 

49. 

*★  - 

105. 

**  _ 

*  Numbers  to  the  left  of  each  pair  indicate  the  position  of  the  item  in 
each  block  of  112  items  on  the  listeners'  answer  sheet. 


**  Filler  items.  The  manner  in  which  these  spaces  are  filled  is  at  the 
option  of  the  experimenter.  Among  other  things,  they  may  be  used  for 
testing  experimental  items. 
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eight  vowel  contexts.  This  involves  two  vowels  from  each 
"quadrant"  of  the  vowel  articulation  diagram.  Thus  the  four  upper 
left  blocks  of  Table  3  involve  high,  front  vowels,  whereas  those 
in  the  four  upper  right  blocks  involve  high,  back  vowels.  The 
low,  front  vowels  are  represented  in  the  four  lower  left  blocks, 
while  the  low,  back  vowels  are  represented  in  the  lower  right 
blocks.  No  central  vowels  are  used  ir  the  DRT. 

There  are  two  grossly  equivalent  items  (e.g.,  bean>peen  and 
veal-feel)  designed  to  test  for  the  apprehensibility  of  each  attri 
bute  in  each  vowel  context,  which  redundancy  serves,  among  other 
things,  to  facilitate  various  tests  of  the  reliability  or  consis¬ 
tency  of  listener  performance  over  the  course  of  a  testing  session 
Either  member  of  each  pair  may  be  chosen  as  the  stimulus  word  in 
a  given  instance  without  changing  the  function  of  the  item  quali¬ 
tatively,  Choice  of  stimulus  w jrd  affects  only  the  polarity  of 
the  test  provided  by  the  item. 

It  is  perhaps  apparent  from  the  table  that  insufficient 
latitude  exists  to  permit  any  degree  of  selectivity  on  the  basis 
of  frequency  of  word  occurrence  in  speech  or  printed  matter. 

:  F 

However,  results  such  as  those  of  Pollack,  Rubinstein  and  Decker 
r.uggest  that  frequency  of  use  influences  the  perceptibility  of 
complex  stimuli  primarily,  if  not  only,  ai:  it  provides  a  basis 
for  the  listener's  expectation  concerning  the  occurrence  of  the 
stimulus.  Where  other,  more  explicit,  bases  for  expectation  are 
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available  --  as  they  are  in  the  case  of  the  DRT  --  frequency  of 
use  may  reasonably  be  expected  to  have  little  or  no  Influence  on 
listener  response,  particularly,  perhaps,  where  the  listener  is 
required.  In  effect,  simply  to  discriminate  a  specific  aspect  of 
the  total  stimulus  event,  rather  than  to  "recognize”  the  stimulus. 

It  may  also  be  noted  by  reference  to  Tables  2  and  3  that 
there  are  some  minor  exceptions  to  the  rule  of  "unidimensional 
difference"  between  members  of  each  word  pair.  This  results  from 
the  fact  that  all  compact  items  are  here  classified  indifferently 
with  respect  to  grave ness  (rather  than  positively,  as  in  Halle's 
taxonomy).  Thus,  while  the  phonemes  ccmprising  the  pairs  /k-p/. 
/g-b/,  /k-t/,  /g-d/,  etc.,  differ  primarily  with  respect  to  com- 
pactness ,  they  might  be  considered  to  differ  secondarily  in  terms 
of  graveness  in  that  the  first  member  of  each  pair  has  a  neutral 
or  indeterminate  status  with  respect  to  the  latter  attribute, 
while  the  second  member  of  each  pair  has  a  positive  or  negative 
status.  In  terms  of  the  taxonomy  in  Table  2,  there  are,  in  other 
words,  no  phoneme  pairs  whose  members  are  distinguished  pure ly  on 
the  basis  of  compactness .  However,  adoption  of  Halle's  system, 
whatever  its  merits  in  this  application,  would  restrict  the  avail¬ 
able  phoneme  pairs  to  those  involving  the  "back-front"  opposition. 
Data  on  phonemic  confusabillty  (e.g..  Miller  and  Nicely)  suggest 
that  the  solution  proposed  here  tends  to  conform  most  nearly  with 
the  facts  of  phonemic  perception.  Some  experimental  justification 
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for  this  course  of  action  is  also  provided  by  lesults  to  the 
effect  that  the  apprehensibility  of  compactness,  as  measured  by 
such  items,  is  quite  differently  affected  by  various  forms  of 
signal  impoverishment  than  is  graveness . 

In  recognition  of  experimental  evidence  that  the  acoustical 
correlates  of  the  state  of  a  given  attribute  may  not  be  equally 
apprehensible  in  every  instance  of  its  manifestation,  nor  equally 
vulnerable  to  all  forms  of  signal  impoverishment,  various  addi¬ 
tional  constraints  were  imposed  in  assembling  the  corpus  shown 
in  Table  3.  Among  the  more  important  of  these  are: 

1.  In  one-half  the  items  designed  to  test  for  the  appre¬ 
hensibility  of  voicing,  both  critical  phonemes  involve 
friction;  in  the  other  half,  friction  is  absent.  Balance 
between  the  upper  and  lower  and  between  the  front  and  back 
halves  of  the  vowel  space  is  maintained  with  respect  to 
these  three  taxonomic  dimensions  as  well  as  to  graveness 
and  compactness . 

2.  Half  of  the  nasality  items  in  each  vowel  context  lie  in 
the  "grave  plane,"  i.e.,  involve  grave  phoneme  pairs;  half 
are  in  the  acute  plane.  All,  of  course,  lie  at  the  inter¬ 
section  of  the  voiced,  interrupted,  unsibilated,  and  diffuse 
planes . 

3.  Half  of  the  items  designed  to  test  for  the  apprehensibi¬ 
lity  of  sustention  lie  in  the  voiced  plane;  half  in  the  un¬ 
voiced.  This  dichotomy  is  not  preserved  within  each  vowel 
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context,  due  to  the  constraints  inherent  in  the  language, 
but  each  quadrant  of  the  vowel  space  is  balanced  in  this 
respect . 

4.  Half  of  the  sibilation  items  in  each  vowel  context  lie 
in  the  voiced  plane;  half  lie  in  the  unvoiced.  But  for  the 
pair  ZEE-THEE,  there  is  perfect  85mimetry  of  halves  of  the 
vowel  space. 

5.  In  the  case  of  graveness .  items  were  selected  such  that, 
for  each  vowel  environment,  one  item  lies  in  the  voiced 
plane,  one  in  the  unvoiced;  one  lies  in  the  sustained  plane, 
one  in  the  interrupted. 

6.  In  addition  to  the  constraints  previously  noted  with 
respect  to  compactness ,  items  were  selected  such  that,  for 
each  quadrant  of  the  vowel  space,  one  item  lies  in  the 
vowel-like  plane  and  one  item  lies  in  the  sibilated  plane. 
All  combinations  of  the  states  of  voicing  and  sustention  are 
given  equal  representation  in  each  quadrant  of  the  vowel 
plane. 

With  minor  exceptions,  the  two  halves  of  the  vowel  space, 
partitioned  horizontally  or  vertically,  involve  identical  phoneme 
pairs  for  testing  the  apprehensibility  of  any  attribute. 
Preparation  of  Stimulus  Materials 

The  first  steps  in  the  preparation  of  test  speech  materials 
involve  the  determination  of  sequential  arrangements  of  items  and 
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the  selection  of  a  stimulus  word  from  each  Item.  Assuming  that 
adequate  precautions  are  made  to  counterbalance  the  effects  of 
fatigue,  "warm  up,"  etc.,  there  are  no  theoretical  bases  for 
favoring  one  item  order  over  another.  Nor,  for  that  matter,  is 
there  any  compelling  reason  for  using  more  than  one  order.  It 
has  proved  useful,  from  a  practical  standpoint,  to  order  the  test 
items  so  that  the  apprehensibility  of  each  attribute  is  tested 
once  with  every  seventh  item,  as  well  as  to  vary  the  vowel  con¬ 
text  such  that  the  eight  vowels  are  cycled  every  eight  items. 

One  ordering  yielded  by  this  procedure  is  indicated  by  the  numbers 
to  the  left  of  the  items  in  Table  3,  and  it  is  suggested  that  this 
ordering  be  incorporated  as  a  standard  of  ORT  testing  procedure, 
except  where  special  circumstances  may  dictate  otherwise. 

For  general  testing  purposes,  the  list  of  test  items  is 
cycled  four  times  ("normal  administration"),  one  stimulus  word 
being  selected  from  each  item  or  word  pair  on  each  cycle,  to  yield 
a  total  of  448  stimulus  words  (including  64  experimental  words). 
Depending  on  the  design  of  the  listener's  answer  sheet,  additional 
"filler  items"  may  be  used  to  absorb  the  effects  of  distraction  or 
delay  occasioned  by  page  changes,  etc.  A  typical  answer  sheet  is 
shown  in  Figure  1.  The  first  item  in  each  column  is  a  filler  item, 
as  are  the  eighth  and  every  seventh  item  thereafter. 

Selection  of  the  stimulus  word  from  each  pair  can  be  effec¬ 
tively  random  in  each  instance  but  for  the  requirement  that  each 
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PEST  -  TEST 
VAULT  -  FAULT 
DUES  -  NEWS 
VEE  -  BEE 
THANK  -  SANK 
ROD  -  WAD 
SO  -  SHOW 
LID  -  RID 
DENSE  -  TENSE 
BOSS  -  MOSS 
FOO  -  POOH 
ZEE  -  THEE 
FAD  -  THAD 
HOP  -  FOP 
ROW  -  LOW 
GIN  -  CHIN 
BEND  -  MEND 
CHAW  -  SHAW 
JUICE  -  GOOSE 
PEAK  -  TEAK 
BAT  -  GAT 
ROCK  -  LOCK 
GOAT  -  COAT 
MIT  -  BIT 
THEN  -  DEN 
GAUZE  -  JAWS 
NOON  -  NOON 
KEY  -  TEA 
RAMP  -  LAMP 


FAN  -  PAN 
CHOCK  -  JOCK 
NOTE  -  DOTE 
TICK  -  THICK 
CARE  -  CHAIR 
DONG  -  BONG 
YOU  -  RUE 
REEK  -  LEAK 
GAFF  -  CALF 
BOMB  -  MOM 
DOUGH  -  THOUGH 
GILT  -  JILT 
PENT  -  TENT 
YAWL  -  WALL 
LOOT  -  ROOT 
VEAL  -  FEEL 
NAB  -  DAB 
BON  -  VON 
SOLE  -  THOLE 
THIN  -  FIN 
KEG  -  PEG 
LONG  -  WRONG 
TUNE  -  DUNE 
MEAT  -  BEAT 
SHAD  -  CHAD 
GOT  -  JOT 
DOLE  -  BOWL 
DILI.  -  GILL 
LEND  -  REND 


Fig.  1.  Specimen  DRT  Answer  Sheet 
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stimulus  word  occur  twice  in  the  course  of  the  administration  and, 
thus ,  that  each  state  of  each  attribute  be  represented  an  equal 
number  of  times  in  each  vowel  context.  It  is  of  some  advantage 
to  require  on  occasion  that  the  two  halves  of  a  normal  adminis¬ 
tration  be  at  least  "balanced,"  i.e.,  that  each  state  of  each 
attribute  be  given  equal  representations  in  each  vowel  context 
in  each  half  of  the  test.  These  constraints  serve  to  partition 
the  test  into  two  identically  equivalent  halves  and  grossly 
equivalent  quarters  and  thus  provide  some  opportunity  for  evaluat¬ 
ing  the  consistency  of  the  listener's  performance  during  the  course 
of  a  test. 

Recording  of  Stimulus  Materials 

For  purposes  of  equipment  or  system  evaluation,  the  test 
words  are  normally  recorded  without  a  carrier  phrase  at  a  rate  of 
one  word  per  1.3  -  1.5  seconds.  Rates  of  this  order  have  been 
found  (Cohen)’*  to  yield  higher  scores  and  smaller  standard  errors 
than  faster  or  slower  rates,  and  of  course  make  somewhat  more 
efficient  use  of  testing  time  than  do  the  rates  normally  used 
with  various  of  the  more  conventional  tests  of  consonant  appre¬ 
hensibility.  When  the  purpose  of  the  test  is  to  evaluate  the 
listener  (particularly  with  very  young  or  handicapped  listeners), 
slower  rates  of  stimulus  presentation  may  be  used. 

An  additional  time  interval  is  provided  between  answer  sheets 
to  give  listeners  ample  time  to  turn  from  one  sheet  to  the  next. 
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A  "filler"  item  is  also  recorded  at  the  place  corresponding  to  the 
top  of  each  column  on  the  listener's  answer  sheet  to  provide  fur¬ 
ther  insulation  against  any  distraction  that  might  be  occasioned 
by  spatial  disparities  between  successive  items  on  the  listener's 
answer  sheet. 

No  attempt  is  made  to  achieve  a  uniform  level  from  one  test 
word  to  the  next,  but  an  attempt  is  made  to  establish  a  fixed 
recording  level  which  will  yield  an  average  vowel  peak  value  of 
-2  VU.  On  completion  of  the  editing  process,  averaged  vowel 
peak  values  are  then  used  as  a  basis  for  setting  the  level  of  a 
1  KHz  calibration  tone  which  is  recorded  at  the  beginning  of  each 
tape . 

Speakers  normally  require  some  amount  of  practice  to  achieve 
uniform,  rhythmic  delivery  in  synchrony  with  a  timing  light. 

They  are  Instructed  only  to  "speak  in  a  normal,  conversational 
manner  --  avoid  over-enunciation."  The  rhyming  option  of  each 
stimulus  word  is  shown  next  to  the  stimulus  word  on  the  speaker's 
script  in  order  to  minimize  ambiguity  in  pronunciation.  Subject 
to  the  results  of  research  in  progress,  it  may  prove  feasible  to 
coach  the  speaker  in  various  ways  to  achieve  a  more  "normal" 
manner  of  enunciation  as  defined  by  his  "diagnostic  profile" 
under  various  transmission  conditions. 

Selection  of  Speakers 


The  problem  of  speaker  selection  for  purposes  of  evaluating 
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equipment  or  listener  characteristics  is  yet  to  find  a  generally 
satisfactory  solution.  The  hazards  associated  with  arbitrary 
selection  of  single  speakers  are  evident  from  the  literature. 

It  is  unlikely,  however,  that  the  use  of  two  or  three  haphazardly 
selected  speakers  is  sufficient  to  assure  the  generality  of  re¬ 
sults,  whereas  practical  considerations  often  preclude  the  use 
of  substantially  larger  numbers  of  speakers.  Until  all  of  the 
relevant  speaker  variables  have  been  identified,  the  problem  of 
speaker  selection  can  be  dealt  with  only  in  a  tentative  and, 
necessarily,  somewhat  arbitrary  manner. 

In  one  attempt  to  devise  a  means  of  selecting  a  "typical 
voice,"  a  semantic  differential- type  voice  rating  form  was  used 
to  select  from  a  pool  of  32  speakers  one  voice  which  was  judged 
most  nearly  neutral  with  respect  to  a  set  of  four  perceived 
voice  traits  (PVT's)  as  described  by  Voiers.'* 

Subsequently,  it  has  appeared  that  the  DRT  itself  is  sensi¬ 
tive  in  a  number  of  dimensions  to  differences  among  speakers  and 
may  thus  provide  an  effective  means  of  selecting  speakers  of  de¬ 
sired  characteristics. 

Selection  and  Training  of  Listeners 

A  crew  of  eight,  minimally  trained  listeners  has  been  found 
sufficient  for  most  purposes  of  equipment  evaluation  with  the 
DRT,  although  a  smaller  crew  may  suffice,  depending  on  the  level 
of  precision  desired.  Crews  of  eight  listeners  typically  yield 
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standard  errors  on  the  order  of  17«  (adjusted  for  chance)  over  most 
of  the  range  of  possible  scores.  However,  slightly  larger  values 
obtain  toward  the  lower  end  of  the  intelligibility  scale.  Because 
the  text  exhibits  a  degree  of  listener  sensitivity,  however,  care 
should  be  exercised  in  selecting  listeners  for  tests  conducted  to 
evaluate  speakers  or  communications  equipment.  Clinically  normal 
hearing  below  6,000  Hz  is  desirable.  Standards  based  on  perfor¬ 
mance  on  the  DRT  itself  have  been  found  useful  for  purposes  of 
equipment  evaluation. 

Administration  of  the  Test 

The  use  of  "live"  test  presentation  procedures  tends  to  be 
somewhat  impractical  for  most  purposes,  and  the  use  of  pre-recorded 
materials,  as  described  above,  is  thus  to  be  preferred  in  general. 
For  routine  purposes  of  system  evaluation,  an  average  vowel  peak 
level  of  approximately  72  dB  SPL  (flat  plate)  appears  to  be  most 
satisfactory. 

Listeners  are  instructed  simply  to  strike  out  the  member  of 
each  word  pair  that  they  perceive  to  be  the  stimulus  word.  It  is 
stressed  that  there  are  no  "right  answers"  other  than  those  dic¬ 
tated  by  the  listener's  perceptions  of  the  stimulus  words. 

Scoring  the  Diagnostic  Rhyme  Test 

DRT  response  data  can  be  scored  in  a  diversity  of  ways,  de¬ 
pending  upon  the  interests  of  the  investigator.  Generally,  how¬ 
ever,  greatest  interest  will  attach  to  the  six  major  "diagnostic" 
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scores,  each  constituting  an  indicant  of  the  gross  apprehensi¬ 
bility  of  the  speaker's  intent  with  respect  to  a  given  attribute. 
It  is  possible,  in  addition,  to  fractionate  each  of  the  major 
diagnostic  scores  into  various  components  (e.g.,  to  obtain  separ¬ 
ate  scores  for  the  apprehensibility  of  sustention  in  the  voiced 
and  unvoiced  planes:  voicing  in  the  frictional  -  non-frictional 
planes;  nasality  in  different  vowel  contexts,  and  so  on). 

Separate  scores  for  the  apprehensibility  of  each  state  of 
each  attribute  are  likely  to  be  of  interest  in  that  some  experi¬ 
mental  variables  may  affect  the  apprehensibility  of  the  two 
statt>s  of  some  attributes  in  an  asymmetrical  manner.  The  result¬ 
ing  discrepancy  between  listener  scores  for  the  two  states  of  an 
attribute  is  termed  bias .  It  is  measured  simply  as  the  difference 
between  the  percent  (adjusted  for  chance)  of  the  time  listeners 
correctly  apprehend  the  positive  state  (e.g.,  voiced)  of  an  attri¬ 
bute  and  the  percent  of  the  time  they  correctly  apprehend  the 
negative  state  (e.g.,  unvoiced). 

Finally,  a  total  score,  representing  the  average  of  the  six 
major  diar.nostic  scores  is  likely  to  be  of  interest  in  many  appli¬ 
cations.  Research  with  previous  versions  of  the  DRT  has  shown 
that  such  scores  are  generally  equivalent,  numerically,  to  scores 
yielded  by  the  Fairbanks  Rhyme  Test,  but  there  is  some  indication 
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(Voiers  et  al^.  )  that  the  DRT  is  sensitive  to  certain  types  of 


deficiencies  not  reflected  in  FRT  scores. 
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In  principle,  at  least,  DRT  results  lend  themselves  to 
expression  in  terms  of  signal  detection  theory  or  information 
theory.  However,  a  somewhat  simpler  approach  to  the  scoring 
problem  provides  a  solution  which  is  probably  adequate  for  most 
practical  purposes  and  also  most  consistent  with  prevailing  con¬ 
ventions.  It  involves  the  familiar  correction  for  guessing, 
accomplished  by  means  of  the  following  formula: 

.  .  100  (R  -  W) 

(T) 

where  S  is  the  "true"  percent-correct  responses,  R  is  the  ob¬ 
served  number  of  correct  responses,  W  is  the  observed  number  of 
incorrect  responses,  and  T  is  the  total  number  of  items  involved. 
This  correction  is  applied  to  all  DRT  scores .  including  the  gross 
or  total  score . 

Manual  scoring  of  the  DRT  through  the  use  of  templates  is 
quite  feasible  where  the  investigator  is  concerned  only  with  ob¬ 
taining  a  gross  score  and  perhaps  the  six  major  diagnostic  scores. 
However,  computer  scoring  not  only  facilitates  this  process, 
particularly  where  multiple  scramblings  of  the  test  materials  are 
Involved,  but  also  provides  easy  access  to  a  wealth  of  other 
potentially  useful  data.  Among  these  are  separate  tallies  of 
individual  listener  errors  in  the  apprehension  of  each  state  of 
each  attribute;  error  counts  for  individual  items;  and  total 
errors  per  subject  for  various  subdivisions  of  the  test.  This 
last  serves,  in  light  of  the  systematic  redundancy  of  the  DRT,  to 
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provide  a  powerful  check  on  Che  state  of  alertness  of  individual 
listeners  over  the  course  of  the  test  and  for  keypunching  errors 
during  the  transcription  of  test  data  for  computer  analysis.  A 
specimen  printout  for  one  scoring  scheme  is  shown  in  Fig.  2. 
Validity  of  the  Diagnostic  Rhyme  Test 

It  is  not  possible  within  the  scope  of  this  report  to  treat 
all  aspects  of  the  issue  of  the  validity  of  the  DRT,  but  it  is 
appropriate  at  least  to  address  the  major  issue  regarding  the 
validity  of  the  DRT  and  the  concepts  on  which  it  is  based.  Ob¬ 
viously,  the  value  of  the  DRT  would  be  greatly  restricted  if  it 
proved  insensitive  to  qualitative  differences  in  the  effects  of 
different  forms  of  speech  signal  impoverishment.  It  has,  in  fact, 
proven  highly  sensitive  to  such  differences  and  yielded  results 
consistent  with  known  facts  of  acoustic  phonemics.  Fig.  2  thus 
serves  to  illustrate  the  diversity  of  diagnostic  patterns  yielded 
with  seme  common  forms  of  speech  degradation.  Represented  in  the 
figure  are  speech  high  passed  at  4  KHz,  low  passed  at  800  Hz,  and 
noise  masked  with  a  S/N  ratio  of  +  3dB.  Also  represented  are  the 
averaged  scores  for  a  sample  of  present-day  digital  vocoders. 

All  data  represents  averages  for  two  administrations  of  the 
DRT  for  each  of  six  male  speakers.  A  crew  of  eight  male  listen¬ 
ers  was  used.  There  are  important  similarities  and  differences 
among  the  results  for  the  four  conditions.  They  show,  for  one 
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thing,  that  the  sustained- interrupted  and  grave-acute  distinctions 
tend  rather  generally  to  be  most  difficult  and  most  susceptible 
CO  speech  impoverishment.  Voicing  and  nasality,  on  the  other 
hand,  retain  a  high  level  of  apprehensibility  under  most  condi¬ 
tions  of  signal  impoverishment.  Voicing  does  not,  however,  remain 
equally  apprehensible  under  all  conditions  and  is  predictably, 
perhaps,  relatively  more  apprehensible  under  low  pass  than  high 
pass  conditions. 

Particular  interest  possibly  attaches  to  the  comparison  of 
results  for  noise  masked  and  low  passed  speech.  As  many  investi¬ 
gators  have  noted,  band  limited  Gaussian  noise  has  the  effect  of 
hij.'h  frequency  attenuation  due  to  the  relatively  low  level  of 
speech  energy  in  the  higher  frequencies  of  the  speech  spectrum. 

The  diagnostic  patterns  found  here  to  characterize  the  two  cases 
are  in  fact  quite  similar  in  most  respects.  They  are  readily 
differentiated,  however,  on  the  basis  of  the  sibilation  scale  of 
the  DRT.  Predictably,  low  pass  filtering  greatly  reduces  the 
apprehensibility  of  sibilation.  Less  predictably,  however, 
noise  has  relatively  little  impact  upon  the  apprehensibility  of 
this  attribute,  in  spite  of  the  fact  that  noise  is  itself  the 
major  acoustical  correlate  of  the  attribute.  Differences  between 
the  diagnostic  patterns  for  high  passed  and  low  passed  speech 
are  of  a  generally  predictable  character.  Their  similarities  in 
terms  of  graveness  are  also  predictable  in  that  the  ranges  of  the 
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second  and  third  forina,iit8  were  largely  excluded  by  both  pass 
bands . 

The  foregoing  results  attest  to  one  aspect  of  the  validity 
of  the  DRT,  its  sensitivity  to  qualitation  differences  in  the 
characteristics  of  transmission  channels  or  media.  Various 
other  aspects  of  this  issue  will  be  dealt  with  in  forthcoming 
reports . 
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CHAPTER  2 


THE  NATURE  OF  INDIVIDUAL  DIFFERENCES 
IN  DIAGNOSTIC  RHYME  TEST  PERFORMANCE 

by 


William  D.  Voiers  and  Alan  D.  Sharp ley 


INTRODUCTION 


Sampling  error  associated  with  listeners  is  a  perennial 
problem  for  the  investigator  who  uses  the  response  of  human 
listeners  to  evaluate  the  performance  of  speech  communication 
and  processing  equipment.  The  precision  of  such  evaluations, 
and  in  turn  the  power  of  statistical  tests  performed  in  conjunc¬ 
tion  with  them,  varies  inversely  with  degree  of  inter-listener 
variation.  Thus  methods  of  controlling  inter-listener  variation, 
whether  by  statistical  or  experimental  means,  offer  possibilities 
for  enhancing  the  precision  or  reliability  of  intelligibility 
test  results.  However,  the  development  of  such  methods  pre¬ 
supposes  some  understanding  of  the  ^  igin  and  nature,  as  well  as 
the  degree,  of  inter-individual  variation  in  speech  discrimina¬ 
tion  ability. 

The  effects  upon  speech  perception  of  individual  differences 
associated  with  pathology  have  been  extensively  investigated. 
Generally,  major  emphasis  has  been  upon  the  degree  rather  than 
the  nature  of  the  discriminative  deficiencies  associated  with 
various  pathological  conditions.  In  one  case,  however,  the  Diag¬ 
nostic  Rhyme  Test  was  used  to  investigate  the  effects  of  pathology 
upon  specific  speech  discrimination  abilities,  and  provided  some 
valuable  insights.’  This  investigation  revealed  quite  clearly 
that  the  effects  of  sensori-neural  hearing  impairment  on  speech 
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discrimination  performance  are  of  a  1  ighly  specific  rather  than 
general  character.  Depending  upon  degree  and  nature  of  hearing 
impairment,  different  aspects  of  speech  discrimination  perform¬ 
ance  are  affected.  Within  the  clinical  population,  at  least, 
speech  discrimination  ability  is  not  a  unidimensional  entity. 

The  nature  of  inter- individual  differences  in  speech  dis¬ 
crimination  ability  in  the  normal  hearing  population  is  yet  to 
be  extensively  investigated.  However,  the  results  of  an  investi¬ 
gation  by  Elliott  ^  al,-*  throws  some  light  on  the  issue.  These 
investigators  employed  factor  analytic  techniques  in  an  attempt 
to  identify  the  correlates  of  verbal  recognition  ability  as 
measured  by  the  Fairbanks  Rhyma  Test.  They  found  performance 
on  the  Fairbanks  test  to  be  correlated  with  individual  differ¬ 
ences  on  both  auditory  and  "non-auditory"  tests .  Among  the  "non- 
auditory"  correlates  of  Rhyme  Test  performance  were  :  vocabulary 
test  performance ,  word  fluency.  In  both  cases  correlations  with 
performance  on  the  Fiarbanks  Rhyme  Test  were  positive.  Auditory 
discrimination  measures  that  correlated  significantly  with  Fair¬ 
banks  Rhyme  Test  performance  were  absolute  thresholds  ^qr  pure 
tones  and  difference  thresho Ids  for  tonal  duration,  frequency  and 
intensity.  Unexpectedly,  however,  the  correlations  between  Rh5rme 
Test  scores  and  absolute  threshold  measures  were  negative .  which 
fact  implies  that  hearing  loss  (at  least  over  the  range  involved) 
is  associated  with  superior  performance  on  the  Fairbanks  Rhyme 
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Test.  Of  the  seven  factors  revealed  by  the  factor  analysis,  the 
Fairbanks  Rhyme  Test  exhibited  substantial  loadings  on  five, 
Including  a  factor  defined  primarily  by  measures  of  Intellectual 
aptitude. 

Given  that  speech  discrimination  ability  as  measured  by 
the  Fairbanks  Rhyme  Test  has  such  a  diversity  of  antecedents, 
the  question  arises  as  to  whether  speech  discrimination  Involves 
a  single  ability  or  a  number  of  Independent  abilities.  Is  It  In 
fact  a  single,  global  ability,  or  a  congeries  of  more  elementary 
abilities.  Because  of  the  diversity  of  measures  It  yields,  the 
Diagnostic  Rh3rme  Test  Is  eminently  adapted  to  the  purpose  of 
resolving  this  issue.  Accordingly,  a  factor  analytic  investiga¬ 
tion  of  Individual  differences  In  Diagnostic  Rhyme  Test  perform¬ 


ance  was  undertaken. 
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METHOD  AND  MATERIALS 


Sublects 

Subjects  for  this  investigation  were  72  male  college  students 
from  the  University  of  Texas,  all  of  whom  were  born  and  raised  in 
the  United  States.  Their  ages  range  from  17  •  36.  They  were 
paid  at  the  rate  of  $2. 00/hr.  to  participate  in  this  and  related 
investigations . 

Speaker 

A  single,  male  speaker  (RD)  recorded  all  of  the  speech 
materials  in  this  investigation.  He  was  selected  on  the  basis 
of  research  results  which  revealed  him  to  have  a  highly  typical 
DRT  diagnostic  score  pattern  under  a  diversity  of  transmission 
conditions . 

Test  Materials 

Subjects  were  administered  the  following  tests  in  random 
groups  of  eight: 

1.  Diagnostic  Rhyme  Test  III  (nine  administrations,  differ¬ 
ent  randomizations,  the  first  two  of  which  yielded  data  used  in 
this  investigation). 

2.  Fairbanks  Rhyme  Test  (five  administrations,  different 
randomizations,  the  first  two  of  which  yielded  data  used  in  this 
investigation) . 

3.  Cooperative  English  Test  -  Form  IB  -  I  (A  four-choice 
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test  of  EngKsh  vocabulary). 

4.  Cooperative  English  Test  -  Form  lA  -  I  (A  four-choice 
test  for  the  effectiveness  of  English  expression). 

5.  Wide  Range  Vocabulary  Test  (A  five-choice  test  of  Eng¬ 
lish  vocabulary). 

6.  Word  Productiveness  Test  (A  test  of  the  ability  to  pro¬ 
duce  words  with  common  initial  consonants  --  j ,  g,  b,  h) . 

7.  Pure  Tone  Audiometric  Tests  (Two  administrations,  Rud- 
mose  ARJ-4A  B^k^sy  recording  audiometer;  audiometric  data  for 
each  subject's  "best  ear"  were  used  in  the  analysis.  The  "best 
ear"  was  selected  on  the  basis  of  lower  total  loss  across  the 
five  frequencies  tested). 

8.  Minnesota  Multiphasic  Personality  Inventory  (A  series 
of  preliminary  analyses  failed  to  reveal  any  significant  person¬ 
ality  correlates  of  speech  discrimination  performance.  Accord¬ 
ingly,  data  from  this  test  are  not  treated  in  the  present  investi¬ 
gation)  . 

Scores  for  each  subject  on  17  variables  were  obtained  with 
the  test  materials  described  above.  Data  on  these  variables 
were  then  used  for  purposes  of  a  factor  analytic  examination  of 
individual  differences  in  speech  discrimination.  The  variables 
treated  in  the  analysis  were: 

1.  DRT  -  Total  Diagnostic  Rhyme  Test  (DRT)  percentage  score* 

2.  VOIC  -  Score  on  the  Voicing  sub-test  of  the  DRT* 
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3.  NAR»  -  Score  on  the  Nasalit/  sub-test  of  the  DRT* 

4.  SUST  -  Score  on  the  Sustention  sub-test  of  the  DRT* 

5.  SIBI  -  Score  on  the  Sibilation  sub-test  of  the  DRT* 

6.  GRAV  -  Score  on  the  Graveness  sub-test  of  the  DRT* 

7.  CMPT  -  Score  on  the  Compactness  sub- test  of  the  DRT* 

8.  FRT  -  Fairbanks  Rhyme  Test  percentage  score* 

9.  VOCB  -  Cooperative  English  Test  (vocabulary)  percentage 

score 

10.  EFCT  -  Cooperative  English  Test  (effectiveness)  percent¬ 

age  score 

11.  WRVT  -  Wide  Range  Vo(  abulary  Test  percentage  score 

12.  WPT  -  Word  Productiveness  Test  -  average  number  of 

words  produced  for  four  initial  consonants 

13.  IK  -  Hearing  loss  (dB  re  ISO- 1964  standards)  at  1000  Hz* 

14.  2K  -  Hearing  loss  at  2000  Hz* 

15.  3K  -  Hearing  loss  at  3000  Hz* 

16.  4K  -  Hearing  loss  at  4000  Hz* 

17.  6K  -  Hearing  loss  at  6000  Hz* 


*Average  score  for  two  administrations 
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RESULTS  AND  DISCUSSION 

The  matrix  of  product -moment  correlations  among  the  seventeen 
variables  under  investigation  is  presented  in  Table  4,  Coeffi¬ 
cients  of  reliability  are  shown  in  the  cells  of  the  major  diag¬ 
onal  axis.  Several  aspects  of  these  results  merit  comment,  for 
example,  the  correlation  between  FRT  and  total  DRT  score  which, 
though  positive,  is  negligible.  Evidently  the  two  tests  tap 
somewhat  different  aspects  of  speech  discrimination  ability,  and 
only  VOIC  and  SIBL  exhibit  significant  (p<,01)  correlation  with 
the  FRT.  Negligible  correlations  obtain  for  the  cases  of  all 
other  DRT  sub-tests. 

It  is  also  noteworthy  that  no  measure  of  speech  discrimina¬ 
tion  ability  exhibits  a  significant  positive  correlation  with  any 
measure  of  auditory  sensitivity.  In  fact,  the  only  correlations 
which  approach  statistical  significance  are  of  negative  sign. 
However,  in  contrast  with  the  results  of  Elliott  e£  al^.  , 
all  correlations  between  measures  of  auditory  sensitivity  and 
FRT  performance  are  in  the  positive  direction,  though  of  negligi¬ 
ble  magnitude. 

Various  other  aspects  of  Table  4  would  merit  discussion,  but 
the  issues  on  which  they  bear  are  brought  into  somewhat  clearer 
focus  by  means  of  factor  analysis.  Factor  analysis  of  the  corre¬ 
lation  matrix  in  Table  4  yielded  seven  orthogonal  factors  which 
accounted  for  93  percent  of  the  systematic  variations  among 


TABLE  4  Correlation  Matrix  for  Seventeen  Listener  Variables 
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listeners.  R.itation  of  axis  to  a  varimax  crite-ion  of  simple 
structure  yie'ded  the  pattern  of  loadings  shown  in  Table  5, 

Factor  I  is  defined  by  the  various  measures  of  verbal  apti¬ 
tude.  No  other  variables  have  significant  loadings  on  this 
factor . 

Factor  II  is  defined  by  measures  of  auditory  sensitivity. 

No  -ither  variables  have  significant  loadings  on  this  factor. 
Although  Elliott  observed  negative  correlations  between 

measures  of  auditory  sensitivity  and  Fairbanks  Rhyme  Test  scores, 
no  such  relation  is  indicated  here.  Nor  is  there  any  indication 
tiiat  DRT  performance  depends  to  any  deg -ee  on  auditory  sensitivity 
to  pure  tone  stimuli,  at  least  within  the  range  of  auditory  sensi¬ 
tivity  characte 'ist ic  of  this  sample  of  listeners.  As  noted 
earlier,  however,  the  DRT  is  sensitive  to  auditory  deficiencies 
of  pathological  magnitude. 

Factor  III  is  defined  primarily  by  the  DRT  sub-test  for  the 
apprehensibility  of  sustention.  Several  other  variables  have 
appreciable  loadings  on  this  factor,  but  the  FRT  would  appear  to 
be  insensitive  to  this  dinension  of  inter-individual  variation. 

Several  variables  contribute  to  the  definition  of  Factor  IV. 
They  include  the  Fairbanks  Rhyme  Test,  the  Wide  Range  Vocabulary 
Test  scores,  and  scores  for  the  two  DRT  attributes,  voic ing  and 
sibilation .  The  loading  of  WRVT  indicates  a  positive  relation¬ 


ship  between  verbal  ability  (as  measured  by  vocabulary)  and 
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TABLE  5.  Factorial  Structure  of  Seventeen  Listener  Variables 
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scores  on  the  FRT,  which  finding  is  generally  consistent  with  the 
results  of  Elliott  e^  al^.  The  loading  of  VOIC  is  in  line  with 
previous  observations  concerning  the  structure  of  the  FRT, 
but  the  SIBL  loading  was  somewhat  surprising,  since  one 
possible  deficiency  of  the  FRT  is  the  negligible  demand  it  makes 
upon  the  listener  with  respect  to  this  attribute  of  consonant 
phonemes . * 

WPT  defines  Factor  VI,  and  several  DRT  variables  exhibit 
substantial  loadings  on  this  factor.  The  FRT,  however,  has  a 
negligible  loading.  Possibly  this  factor  relates  to  some  aspect 
of  perceptual  motor  speed  or  test-taking  skill.  The  rapid  pace 
at  which  listeners  must  work  in  taking  the  DRT  (one  response 
every  l.A  seconds)  might  thus  account  for  the  loadings  exhibited 
by  various  DRT  variables.  A  question  arises,  hotrever,  as  to  why 
the  FRT,  which  involves  the  same  stimulus  presentation  rate,  does 
not  exhibit  a  high  loading.  The  answer  to  this  question  is  not 
clear,  but  one  possibility  derives  from  the  fact  that  all  listen¬ 
ers  were  given  extensive  exposure  to  the  DRT  before  taking  the 
FRT.  Possibly,  therefore,  they  were  more  nearly  habituated  to 
the  time  pressures  involved  by  the  time  they  took  the  FRT. 

Factor  VII  evidently  represents  a  dimension  of  speech  dis¬ 
crimination  skill  in  that  the  total  DRT  score  and  three  of  its 
components  --  nasality,  sibilation  and  graveness  --  have  sub¬ 
stantial  loadings  on  this  factor.  The  slightly  negative  loading 
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for  FRT  Is  somewhat  puzzling,  but  can  probably  be  attributed  to 
chance . 

From  the  foregoing  it  is  evident  that  at  least  three  inde¬ 
pendent  factors  (III,  IV  and  VII)  contribute  to  listener  varia¬ 
tion  in  speech  discrimination  performance.  The  first  of  these 
(defined  by  SUST)  appears  to  be  related  to  the  ability  to  dis¬ 
criminate  characteristics  of  the  speech  envelope  while  the  second 
appears  to  involve  the  ability  to  detect  the  presence  and  character 
of  noise.  The  third  appears  to  involve  the  ability  to  discrimin¬ 
ate  the  characteristics  and  relationship  of  the  first  three 
formants.  Other  dimensions  might  have  emerged  but  for  the  fact 
chat  all  speech  materials  were  presented  under  high  fidelity 
conditions,  which  circumstance  may  have  operated  to  miniiiiize 
inter-listener  variation  in  potentially  significant  dimensions 
of  discriminative  ability. 

It  appears  that  the  FRT  is  a  relatively  unitary  measure, 
loading  substantially  on  only  a  single  factor.  Conceivably, 
therefore,  it  fails  to  tap  certain  aspects  of  the  speech  discrim¬ 
ination  task.  The  DRT,  on  the  other  hand,  has  fairly  high  load¬ 
ings  on  all  factory  involving  speech  discrimination,  and  would 
thus  appear  to  provide  a  more  comprehensive  measure  of  the  ade¬ 
quacy  of  a  listener's  discriminative  capacity. 

Clearly,  additional  research  will  be  required  to  resolve  the 
issue  completely,  but  the  results  of  this  investigation  strongly 


suggest  that  speech  perception  invob'es  more  than  one  dimension 
of  inter-indl vidual  variation  in  discriminative  capacity.  This 
suggestion  has  obvious  implications  for  the  development  of  pro¬ 
cedures  for  selecting  operational  communication  personnel  as 
well  as  listeners  to  be  used  in  the  research  and  testing  situa¬ 


tions  . 
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CHAPTER  3 


SPEAKER  EFFECTS  ON  INTELLIGIBILITY 
TEST  RESULTS 

by 


William  D.  Volers  and  Carl  J.  Hehmsoth 


SPEAKER  EFFECTS  ON  INTELLIGIBILITY 
TEST  RESULTS 

THE  PROBLEM 

The  possible  effects  of  a  speaker's  idiosyncracles  upon 
the  results  of  intelligibility  tests  conducted  to  evaluate  com¬ 
munications  equipment  has  long  been  a  matter  of  concern  to  inves¬ 
tigators  in  the  field  of  speech  communication.  But  while  it  is 
clear  that  speaker  effects  exist,  the  nature  of  these  effects 
has  not  been  extensively  investigated. 

The  distinction  between  general  effects  and  interactive 
effects  is  particularly  important  in  this  context.  To  the  ex¬ 
tent  that  differences  among  speakers  tend  to  remain  constant 
across  transmission  conditions  or  situations,  the  speaker  effect 
involves  a  general  component.  To  the  extent  that  speaker  differ¬ 
ences  vary  from  one  transmission  condition  to  the  next,  the 
speaker  effect  involves  an  interactive  component. 

The  obvious  practical  consequence  of  any  type  of  speaker 
effect  is  that,  normally,  systems  evaluated  with  one  speaker 
cannot  be  directly  compared  to  systems  evaluated  with  a  differ¬ 
ent  speaker.  However,  the  possibility  may  exist  of  independently 
evaluating  general  differences  among  speakers  and  in  turn  ad¬ 
justing  results  obtained  with  individual  speakers  in  such  a  way 
as  to  render  them  comparable. 
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To  the  extent  that  speaker  idiosyncracies  are  Interactive 
with  transmission  conditions  (i.e.,  to  the  extent  that  differ¬ 
ent  systems  may  respond  to  different  voices  in  different  ways) 
system  comparisons  involving  different  speakers  are  potentially 
invalid.  Control  of  such  effects  is,  moreover,  difficult  to 
accomplish  by  means  other  than  those  involving  the  use  of  large 
samples  of  speakers. 

In  addition  to  the  effects  of  gross  differences  in  speaker 
intelligibility,  general  and  interactive,  there  exists  the  pos¬ 
sibility  that  speakers  differ  systematically  in  terms  of  the 
apprehensibility  of  specific  speech  features.  Thus  speakers 
who  yield  comparable  measures  of  gross  intelligibility  under  a 
given  condition  may  nevertheless  be  characterized  by  qualitative 
differences  in  intelligibility,  i.e.,  the  discriminability  of 
certain  speech  features  may  vary  from  one  speaker  to  the  next. 
Such  effects  have  obvious  implications  for  the  technology  of 
diagnostic  intelligibility  testing. 

A  comprehensive  treatment  of  the  issues  raised  here  is 
beyond  the  scope  of  the  present  project.  However,  various 
results  obtained  in  the  course  of  the  project  provide  some  in¬ 
sights  regarding  them.  The  results  of  two  experiments,  in 
particular,  are  relevant  in  this  connection. 

EXPERIMENT  I 

Methods  and  Materials 


Speakers .  Twelve  male  speakers,  selected  primarily  on  the 
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basis  of  availability,  were  used  in  this  investigation. 
Their  ages  ranged  from  20  to  45. 

Listening  Crew.  The  listening  crew  was  composed  of  eight 
males  between  the  ages  of  18  and  24.  All  members  of  the 
crew  had  extensive  experience  with  the  Diagnostic  Rhyme 
Test. 

Test  Materials .  The  Diagnostic  Rhyme  Test  (Form  III)  was 
used  for  purposes  of  this  investigation. 

Test  Conditions .  Diagnostic  Rhyme  Test  materials  as  re¬ 
corded  by  each  of  the  twelve  speakers  were  presented  to  the 
listening  crew  under  a  diversity  of  transmission  conditions. 
Five  of  these  were  selected  for  the  illustrative  purposes 
of  this  investigation.  They  included: 

1.  Undegraded  speech 

2.  Low  passed  (400  Hz)  speech 

3.  High  passed  (3  KHz)  speech 

4.  Noise  masked  (-lOdB  S/N) 

5.  Digitally  vocoded  (1200  bps) 

The  level  of  the  speech  signal,  prior  to  processing,  was 
approximately  72  dB  SPL  in  the  first  four  conditions.  The 
vocoded  speech  was  presented  to  listeners  at  this  same 
level.  All  tests  were  conducted  in  partitioned  lAC  rooms. 
The  test  materials  were  presented  diotically  over  TDH-39 
earphones  mounted  in  Rudmose  Otocups. 
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Results 

The  analyses  of  results  reported  here  are  addressed  to 
the  following  issues: 

1.  Consistency  across  conditions  of  speaker  order  with 
respect  to  gross  intelligibility- 

2.  Consistency  across  test  conditions  of  diagnostic 
score  patterns  of  individual  speakers. 

DRT  total  scores  for  the  twelve  speakers  were  ranked  for  each 
of  the  five  test  conditions.  The  results  are  presented  in 
Table  6. 

TABLE  6.  Ranked  DRT  Scores  of  Twelve  Speakers  Under  Five 
Transmission  Conditions 


Transmission  Conditions 


Speaker 

Undegraded 

High-Pass 

Low-Pass 

Noise 

Vocoded 

A 

8 

11 

6 

7 

7 

B 

12 

1 

12 

8 

12 

C 

6 

8 

5 

6 

6 

D 

9 

12 

3 

11 

3 

E 

3 

10 

4 

4 

9 

F 

4 

3 

2 

1 

8 

G 

10 

5 

10 

10 

10 

H 

11 

7 

7 

9 

4 

I 

7 

6 

8 

5 

5 

J 

2 

4 

9 

3 

2 

K 

1 

2 

1 

2 

1 

L 

5 

9 

11 

12 

11 
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It  is  evident  from  the  table  that,  while  speaker  ranks  under 
the  various  conditions  are  by  no  means  perfectly  Intercorre- 
lated,  a  high  degree  of  Intercorrelation  exists.  Generally, 
speakers  who  rank  high  under  one  condition  tend  to  maintain 
similar  ranks  under  other  conditions.  The  most  notable  excep¬ 
tion  occurs  in  the  case  of  speaker  B.  Ranked  below  average 
on  all  other  conditions,  he  achieves  the  top  rank  in  the  case 
of  high  passed  speech.  The  reasons  for  this  inversion  are 
not  evident.  The  fact  that  speaker  B's  voice  is  the  highest 
pitched  in  this  sample  is  of  possible  interest.  There  is. 
however,  no  indication  otherwise  that  high-pitched  voices 
are  more  intelligible  under  high  pass  conditions. 

Table  7  presents  the  correlations  among  speaker  ranks  for 
the  five  test  conditions  involved  here. 

TABl£  7.  Correlations  (o)  Among  Ranked  DRT  Total  Scores  of 
Twelve  Speakers  for  Five  Transmission  Conditions. 


Condition 

Undegraded 

High-Pass 

Low-Pass 

Noise 

Vocoded 

Undegraded 

High-Pass 

.  10 

-- 

Low- Pass 

.48 

-.16 

-- 

Noise 

.68 

.47 

.53 

-- 

Vocoded 

.37 

-.02 

.54 

.36 

-- 

It  is  evident  from  the  table  that  speaker  ranks  are  not  equally 
predictable  from  any  one  condition  to  another,  although  the  size 
of  the  sample  involved  here  permits  only  the  most  tentative 
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cone lusions . 

Clearly,  intelligibility  measures  obtained  under  conditions 
involving  high-passed  speech  are  of  little  valup  in  predicting 
a  speaker's  relative  level  of  intelligibility  under  other 
transmission  conditions.  However,  the  level  of  predictability 
among  the  various  other  conditions  examined  here  is  at  least 
more  than  negligible  in  all  instances  and  relatively  high  in 
several.  In  particular,  a  speaker's  relative  intelligibility 
under  high  fidelity  conditions  correlates  quite  well  (.68) 
with  his  relative  level  under  noisy  conditions.  More  gener¬ 
ally,  however,  it  must  be  concluded  that  speaker  characteris¬ 
tics  are  interactive  with  channel  characteristics  and  thus 
that  the  results  of  system  conparisons  involving  a  single 
speaker  may  be  of  questionable  validity. 

In  addition  to  the  issue  of  gross  quantitative  differences 
among  speakers,  there  is  also  the  issue  of  qualitative  differ¬ 
ences.  To  what  extent  do  speakers  differ,  for  example,  in 
terns  of  diagnostic  score  patterns?  Are  such  differences 
general  in  nature  or  interactive  with  transmission  conditions? 
To  throw  some  light  on  this  issue,  diagnostic  scores  yielded 
by  the  twelve  speakers  discussed  above  were  examined  under  the 
same  five  transmission  conditions. 

For  this  purpose  diagnostic  data  for  each  transmission  con¬ 
dition  were  adjusted  to  remove  the  effects  of  speaker  differ- 
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ences  in  total  DRT  score.  Data  so  adjusted  were  then  analyzed 
to  obtain  for  each  speaker  an  average  deviation  score,  i.e., 
the  average  of  the  absolute  differences  between  his  adjusted 
scores  on  DRT  sub-tests  and  the  average  score  of  the  group  on 
corresponding  sub-tests.  The  average  so  obtained  thus  represented 
for  each  speaker  an  indicant  of  conformity  (or  nonconformity) 
with  the  group  under  a  given  transmission  condition. 

The  question  then  arises  as  to  what  extent  speakers  who 
yield  deviant  patterns  under  one  condition  tend  also  to 
yield  deviant  patterns  under  others.  Table  8  presents  results 
which  bear  upon  this  question. 


TABLE  8.  Ranked  Deviation  Scores  of  Twelve  Speakers  and  Five 
Transmission  Conditions.’ 

Transmission  Conditions 


Speaker 

Undegraded 

High-Pass  Low-Pass 

Noise 

Vocoded 

A 

11 

12 

6 

11 

9 

B 

1 

2 

4 

12 

1 

C 

3 

9 

11 

8 

12 

D 

7 

1 

3 

1.5 

6 

E 

4 

4 

5 

3 

5 

F 

5 

3 

2 

4.5 

10 

G 

10 

6 

7 

6 

7 

H 

8 

10 

9 

10 

4 

I 

9 

5 

10 

9 

11 

J 

12 

11 

12 

7 

8 

K 

2 

8 

1 

4.5 

3 

L 

6 

7 

8 

1.5 

2 

’Higher  ranks  denote 

smaller 

deviation  scores 

,  i.e.  , 

a  rank  of 

”1"  identifies  the  speaker  with  the  most  typical  diagnostic 
pattern  under  a  given  transmission  condition. 
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r'roni  the  table  it  Is  e'adent  that  speakers  wh  >  yield  typical 
diagnostic  score  patterns  under  one  test  condition  tend  rather 
strt'nglv  to  yield  typical  patterns  under  other  conditions,  but 
pronounced  exceptions  to  this  tendency  are  evident.  Speaker  R, 
for  example,  yields  highly  typical  diagnostic  score  patterns 
under  four  conditions.  In  the  case  of  noise-masked  speech,  how¬ 
ever,  his  pattern  is  the  most  deviant  of  the  group. 

Table  9  shows  the  correlations  among  ranked  deviation  scores 
for  the  five  tranmission  conditions. 

TABLE  9.  Correlations  (  )  Among  Pattern  Deviation  Scores  of 
Twelve  Speakers  for  Five  Transmission  Conditions 


('  )ndition 

Unde^raded 

Hi  ,h-Pass 

Low- Pass 

Noise 

Vocoded 

Undegraded 

High-Pass 

.47 

I.ow-Pass 

.51 

.55 

-- 

Noise 

.  13 

.37 

.32 

-- 

V  ocoded 

.39 

.21 

.39 

.  16 

-- 

In  general,  the  values  of  the  coefficients  of  correlation  are 
sonewhat  higher  than  those  in  Table  7,  suggesting  that  individual 
speakers  tend  more  strongly  to  maintain  their  diagnostic  score 
patterns  from  one  condition  to  the  next  than  to  maintain  their 
relative  level  of  gross  intelligibility.  Correlations  among 
speaker  ranks  are  far  from  perfect,  however. 

It  is  clear,  therefore,  that  speaker  differences  in  overall 
intelligibility  and  in  diagnostic  score  patterns  are  interactive 
with  channel  or  transmission  conditions,  and  that  comparative  test 
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results  obtained  with  a  slnp.le  speaker  may  not  he  generalized 
with  a  high  degree  of  confidence  to  the  population  of  speakers 
at  large.  It  shoul  ■  'e  stressed,  however,  that  the  present  Inves¬ 
tigation  Involved  comparisons  among  extremely  diverse  types  of 
transmission  conditions.  Such  diversity  is  unlikely  to  be  en¬ 
countered  in  practical  testing  situations.  Rather,  the  systems 
or  transmission  conditions  typically  subjected  to  comparative 
evaluation  are  likely  to  Involve  relatively  similar  types  and 
degrees  of  speech  degradation.  The  question  arises,  therefore, 
as  to  the  practical  implications  of  speaker  x  system  Interaction. 
The  scop#*  of  the  present  effort  does  not  permit  a  comprehensive 
investigation  of  this  issue,  but  data  obtained  in  the  course  of 
the  project  throw  some  light  on  the  issue.  They  are  presented 
and  discussed  in  the  following  investigation. 

EXPERIMENT  II 

Methods  and  Materials 

Speakers .  Six  male  speakers,  selected  on  the  basis  of 
availability,  dialectal  characterstics ,  or  pitch  frequency 
were  used  in  this  investigation.  Two  of  the  six  speakers 
were  judged  by  a  listening  crew  to  have  voices  of  higher 
than  average  pitch,  while  two  were  judged  to  have  voices  of 
lower  than  average  piicn,  and  f  o  were  judged  to  have  voices 
of  average  pitch  for  male  speakers. 

Listening  Crew.  The  listening  crew  was  composed  of  eight 


males  between  the  ages  of  18  and  24.  All  members  of  the 
crew  had  extensive  experience  with  the  Diagnostic  Rhyme 
Test . 

Test  Materials .  Recordings  of  DRT  IV  were  used  for  purposes 
of  this  investigation.  Each  speaker  made  four  recordings 
of  the  DRT  IV  test  words.  One  recording  by  each  speaker 
was  then  randomly  selected  and  assembled  into  one  of  four 
six-speaker  test  tapes. 

Test  Conditions .  One  randomly  selected  six-speaker  tape 
was  played  through  each  of  thirteen  modern  digital  speech 
communication  systems  and  the  output  speech  recorded.  Out¬ 
put  recordings  were  then  presented  to  the  listening  crew. 
Results  and  Discussion 

The  analysis  of  results  was  addressed  to  the  issue  of  the 
consistency  of  system  differences  across  speakers.  The  results 
of  this  analysis  are  presented  graphically  in  Fig.  4.  In  the 
figure,  total  DRT  scores,  averaged  for  six  speakers,  are  plotted 
against  the  total  DRT  scores  for  individual  speakers. 

Two  aspects  of  the  plots  are  of  interest.  First  is  the 
slope  of  the  regression  line  for  each  speaker;  second  is  the 
dispersion  of  points  about  each  regression  line.  With  regard  to 
the  first  aspect,  it  is  clear  that  speakers  vary  somewhat  in  terms 
of  absolute  sensitivity  to  the  type(s)  of  degradation  involved. 
Other  things  equal,  speakers  BV,  JE  and  SN  are  somewhat  more 
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sensitive  to  system  differences  than  speakers  RD,  CH  and  BL. 

With  regard  to  consistency  of  results,  however,  the  situation 
is  sofiewhat  different.  Deviations  from  the  indicated  regression 
line  tend  to  be  smaller  for  BV,  RD  and  CH  than  for  the  other 
speakers,  which  results  have  important  practical  implications. 
Specifically,  it  would  appear  that  results  for  these  speakers  con¬ 
form  most  nearly  (but  for  scale  factor  differences)  to  the  results 
for  the  combined  speakers.  Under  circumstances  which  do  not 
warrant  or  permit  the  use  of  multiple  speakers.  BV,  RD  or  CH  would 
be  the  speakers  of  choice.  With  appropriate  adjustments  for 
scale  factors,  data  obtained  from  these  speakers  could  be  used  to 
predict  the  average  scores  that  would  be  obtained  for  the  entire 
group  of  speakers.  Table  10  is  designed  to  implement  this  proce¬ 
dure.  Presented  in  the  table  are  equivalent  group  averages  for 
individual  DRT  IV  scores  yielded  by  each  of  the  six  speakers. 

It  would  appear,  from  the  a'.ove  results,  that  speaker  x 
system  interactive  effects,  while  rather  pronounced  under  extreme 
laboratory  conditions,  may  be  of  relatively  minor  consequence  in 
the  practical  testing  situation  --  particularly  in  the  case  of 
tests  performed  to  compare  generally  similar  devices  or  systems. 

It  is  perhaps  desirable,  however,  to  use  multiple  speakers  when¬ 
ever  feasible  and,  moreover,  to  select  the  speaker(s)  used  on 
the  basis  of  some  such  criteria  as  pattern  deviation  scores 
obtained  under  various,  representative  transmission  conditions. 
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Fig.  4.  Averaged  DRT  Total  Scores  of  Six  Speakers  Plotted  Against  DRT  Total 
of  Individual  Speaker  for  a  Sample  of  Present-Day  Digital  Vocoders. 
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TABLE  10,  Equivalencies  Between  DRT  IV  Total  Scores  for  Individual 
Speakers  and  DRT  IV  Total  Scores  as  Averaged  for  Six 
Speakers . 


BV 

AVER 

RD 

100.000 

97.300 

100.000 

95.000 

93.410 

95.000 

90.000 

89.520 

90.000 

85.000 

85.630 

85.000 

80.000 

81.740 

80.000 

75.000 

77.850 

75.000 

70.000 

73.960 

70.000 

65.000 

70.070 

65.000 

60.000 

66.180 

60.000 

55.000 

62.290 

55.000 

50.000 

58.400 

50.000 

45.000 

54.510 

45.000 

40.000 

50.620 

40.000 

35.000 

46.730 

35.000 

30.000 

42.840 

30.000 

25.000 

38.950 

25.000 

20.000 

35.060 

20.000 

15.000 

31.170 

15.000 

10.000 

27.380 

10.000 

5.000 

23.390 

5.000 

.000 

19.500 

.000 

CH 

AVER 

BL 

100.000 

100.600 

100.000 

95.000 

94.600 

95.000 

90 . 000 

88.600 

90.000 

85.000 

82.600 

85.000 

80.000 

76.600 

80.000 

75.000 

70.600 

75.000 

70.000 

64 . 600 

70.000 

65.000 

58.600 

65.000 

60.000 

52.600 

60.000 

55.000 

46.600 

55.000 

50.000 

40.600 

50.000 

45.000 

34.600 

45.000 

40.000 

28.600 

40.000 

35.000 

22.600 

35.000 

30.000 

16.600 

30.000 

25.000 

10.600 

25.000 

20.000 

4.600 

20.000 

15.000 

-1.400 

15.000 

10.000 

-7.400 

10.000 

5.000 

-13.400 

5.000 

.000 

-19.400 

.000 

AVER 

JE 

AVER 

98.000 

100.000 

97.000 

92.650 

95.000 

92.500 

87.300 

90.000 

88.000 

81.950 

85.000 

83 . 5C0 

76.600 

80.000 

79.000 

71.250 

75,000 

74.500 

65.900 

70.000 

70.000 

60.550 

65.000 

65.500 

55.200 

60.000 

61.000 

49 . 850 

55.000 

56.500 

44.500 

50.000 

52.000 

39.150 

45.000 

47.500 

33.800 

40.000 

43,000 

28.450 

35.000 

38.500 

23.100 

30.000 

34.000 

17.750 

25.000 

29.S00 

12.400 

20.000 

25.000 

7,050 

15.000 

20.500 

1.700 

10,000 

16.000 

-3.650 

5.000 

11.500 

-9.000 

.000 

7.000 

A\nER 

SN 

AVER 

101.600 

100.000 

102.790 

97.015 

95.000 

97.290 

92.430 

90.000 

91.790 

87.845 

85.000 

86.290 

83.260 

80.000 

80.790 

78.675 

75.000 

75.290 

74.090 

70.000 

69.790 

69.505 

65.000 

64.290 

64.920 

60.000 

58.790 

60.335 

55.000 

53.290 

55.750 

50.000 

47.790 

51.165 

45.000 

42.290 

46.580 

40.000 

36.790 

41.995 

35.000 

31.290 

37.410 

30.000 

25.790 

32.825 

25.000 

20.290 

28.240 

20.000 

14.790 

23.655 

15.000 

9.290 

19.070 

10.000 

3.790 

14.485 

5.000 

-1.710 

9.900 

.000 

-7.210 
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STRUCTURE  OF  PHONEMIC  INFORMATION 
IN  THE  ORAL  AND  NASAL  OUTPUTS* 


Introduction 

In  1968  S.  R.  Hyde  reported  a  technique  that  physically 
isolated  the  acoustic  outputs  of  the  oral  and  nasal  cavities.' 
The  technique  involved  the  separation  of  the  two  outputs  by  a 
metal  acoustic  shield  that  was  fitted  to  the  speaker's  head. 

Then,  while  a  speaker  was  fitted  into  the  separation  device, 
the  oral  and  nasal  outputs  were  simultaneously  recorded  during 
continuous  speech.  Hyde's  results  appeared  in  the  form  of  the 
sound  spectrograms  of  the  two  outputs  which  he  compared  to  each 
other  as  well  as  to  the  spectrograms  for  normal  speech. 

The  present  study  uses  a  technique  similar  to  that  described 
by  Hyde,  but,  while  his  interests  lie  primarily  in  the  differ¬ 
ences  among  the  physical  waveforms,  the  purpose  here  is  to  deter¬ 
mine  the  relative  contributions  of  the  two  outputs  to  the  process 
of  consonant  recognition.  The  Diagnostic  Rhyme  Test  is  employed 
in  the  present  study  as  a  means  of  evaluating  the  perceptually 
significant  content  of  the  acoustic  outputs  of  the  oral  and  nasal 
cavities . 

*The  research  described  in  this  report  was  conducted  in  partial 
fulfillment  of  the  requirements  for  the  degree  of  Master  of  Arts, 
the  University  of  Texas,  1970. 
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Acoustic  Shield 

An  acoustic  shield  was  constructed  from  four  sheets  of  acous¬ 
tical  fiberboard  and  two  sheets  of  lead  which  were  notched  to  fit 
around  the  speaker's  head.  During  the  actual  speech  recordings 
the  speaker's  head  was  situated  in  the  center  of  an  8'  x  8'  x  I" 
shield  consisting  of  two  layers  of  fiberboard  separated  by  a  layer 
of  lead.  In  addition  to  its  acoustic  insulation  properties,  the 
lead  provided  the  structure  with  enough  mass  to  damp  the  natural 
fiberboard  resonance.  Fit  of  the  shield  around  the  speaker's 
head  was  sufficient  to  prevent  significant  sound  leakage,  but 
mt  so  tight  as  to  alter  normal  speech  articulation.  The  fiber- 
board  sheets  directly  under  the  speaker's  nostrils  and  directly 
above  his  mouth  were  beveled  ^  inch  in  order  to  minimize  obstruc¬ 
tion  of  the  breath  streams  and  interference  with  upper- labial 
articulation.  Finally,  the  shield  structure  was  suspended  from 
the  ceiling  of  a  sound-proofed,  anechoic  chamber  (12'  x  12'  x  12'). 

A  Bruel  and  Kjaer  free-field  n icrophone  and  a  loudspeaker 
were  connected  to  a  level  recorder  and  a  beat  frequency  oscillator 
in  such  a  way  as  to  measure  the  amount  of  attenuation  provided  by 
the  shield  across  the  frequency  range  50  -  10,000  Hz.  Figure  5 
shows  the  attenuation  characteristic  of  the  acoustic  shield  that 
resulted  from  this  measurement. 

Recording  Procedures  and  Materials 

Bruel  and  Kjaer  #4131  free-field  microphones,  #2613  cathode 
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followers,  and  #2604  amplifiers  were  connected  to  separate 
channels  of  an  Ampex  602.2  tape  recorder.  The  frequency  charac¬ 
teristics  of  the  two  microphones  were  almost  ideitlcal,  being 
essentially  flat  in  the  range  20-10  000  Hz.  The  separate  audio 
subsystems  (microphone,  cathode  follower,  amplifier)  were  cali¬ 
brated  by  pistonphone  so  that  they  had  virtually  identical 
frequency  responses. 

The  microphones  were  suspended  10  cms.  from  their  respective 
sources  at  90*^  incidence,  but  were  kept  close  to  the  shield 
(1  cm.),  so  that  any  speech  reflecting  off  the  surface  of  the 
shield  would  arrive  at  the  microphones  approximately  in  phase 
with  non-ref lected  waves.  Figure  6  shows  b  block  diagram  of  the 
equipment,  shield,  and  chamber  used  to  record  the  speech  naterial. 
Figures  7(a)  and  7(b)  show  the  configuration  of  the  speaker  and 
acoustic  shield  in  the  anechoic  chamber  during  recording  of  the 
speech  materials  in  the  experimental  conditions. 

In  the  control  condition,  the  speaker  was  situated  in  the 
center  of  the  anechoic  chamber  with  his  head  held  firmly  by  a 
special  restraining  device  and  with  a  free-field  microphone  sus¬ 
pended  10  cms.  from  his  mouth  at  90®  incidence.  Speech  material 
was  recorded  on  a  single  channel  of  the  Ampex  tape  recorder  after 
passing  through  one  of  the  microphone/cathode  follower/amplif ier 
sub-systems  described  above. 

Two  randomizations  of  the  Diagnostic  Rhyme  Test  (DRT) 


B&K  2613 
Cathode  — 
Follower 


Shield 


B&K  #  4131  Free 
Field  Microphone 


ANECHOIC  CHAMBER 


B&K  2604 
Microphone 
Amplifier 

Fig.  6.  Diagram  of  Audio  Equipment,  Shield,  and  Chamber  Used 
in  Recording  of  Speech  Material. 


Fig.  7(b).  Speaker  and  Placement  of  the  Nasal  Microphone 
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materials  were  recorded  under  the  experimental  conditions  (two 
microphones  separated  by  the  acoustic  shield)  and  two  randomiza¬ 
tions  under  the  control  conditions  (a  single  microphone).  The 
tapes  were  edited  and  1,000  Hz  calibration  tones  were  recorded 
at  the  same  level  as  the  average  of  the  vowel  peaks  (VU)  for  each 
tape.  Since  multiple  presentations  of  each  randomization  were 
required  in  the  course  of  the  experiment,  each  basic  randomization 
was  partitioned  into  quarters,  which  in  turn  were  ordered  in 
various  ways  to  guard  against  the  effects  of  learning. 

Listeners 

Eight  male  University  of  Texas  undergriduates ,  selected  on 
the  basis  of  consistency  of  performance  on  speech  intelligibility 
tests,  served  as  subjects.  All  had  good  hearing  as  determined  by 
pure  tone  audiometry,  and  had  more  than  40  exposures  to  various 
intelligibility  test  materials  prior  to  their  participation  in 
the  present  investigation. 

Speaker 

A  male  graduate  student  at  the  University  of  Texas  with 
previous  experience  as  an  intelligibility-test  speaker  provided 
all  recorded  speech  materials  for  this  investigation.  His  speech 
was  of  General  American  Dialect  and  showed  no  perceptible  defects 
or  abnormalities.  His  intelligibility  was  highly  typical  of  a 
large  pool  of  male  speakers  under  a  variety  of  speech  transmission 


conditions . 
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Presentation  Apparatus  and  PeslRn 

Two  (6'  X  12')  double-walled  I.A.C.  rooms  were  each  parti¬ 
tioned  into  four  listening  booths.  Speech  recordings  (DRT)  were 
played  on  an  Ampex  602.2  stereo  tape  recorder  and  channeled 
through  a  high  quality,  custom  built  audio  mixer/amplif ier , 
where  presentation  condition  and  speech  level  was  determined. 

The  amplified,  and,  under  one  condition,  mixed,  speech  was  then 
low-passed  at  8,000  Hz  by  a  Krohn-Hite  (48  dB/octave)  filter, 
and  presented  through  TDH-39  earphones  cased  in  Rudmose  Otocups. 

Throughout  the  experiment,  speech  level  remained  constant 
at  approximately  45  dB  SPL  for  the  average  of  the  vowel  peaks. 

The  experimental  design  involved  four  conditions,  each  represent¬ 
ing  a  different  recording  mode.  Two  DRT's  were  presented  under 
each  of  the  three  experimental  conditions:  nasal  output  (NO), 
oral  output  (00),  electronically  mixed  nasal  and  oral  outputs  (EM), 
and  the  single  microphone  control  condition.  The  eight  DRT's 
were  presented  in  two  one-hour  testing  sessions  (four  to  each) 
in  a  counterbalanced  arrangement. 

Results 

Data  for  the  DRT  are  presented  as  "percent  correct  discrim¬ 
ination"  scores.  For  each  of  the  attributes  (voicing,  nasality, 
sustention,  sibilation,  graveness,  and  compactness)  used  in  the 
DRT,  attribute  present,  absent,  mean,  and  bias  (present  -  absent) 
scores,  as  well  as  a  "Total  DRT  Score,"  are  presented  for  each  of 
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the  experimental  conditions. 

The  "Total  DRT  Score"  may  be  used  as  a  gross  measure  of 
overall  Intelligibility  In  that  it  has  been  found  to  correlate 
highly  with  scores  of  other  conventional  Intelligibility  tests, 
l.e.,  the  Fairbanks  Rhyme  Test The  total  DRT  Score 
for  the  NO  condition  (24.9)  Indicates  that  It  was  consi¬ 
derably  less  intelligible  than  any  of  the  other  conditions.  It 
was  also  found  that  the  total  scores  for  00  (93.8)  and  EM  (94.9) 
differed  non-slgnlf Icantly  from  the  control  (95.11  and  from  each 
other.  Scores  for  each  of  six  consonant  attributes  und  r  the 
three  experimental  conditions  and  the  control  condition  are 
presented  In  Tables  11  to  14. 

The  attribute  scores  for  NO  are,  with  a  few  exceptions, 
quite  low  --  many  differing  non-slgnlf leant ly  from  chance 
(Table  11).  The  exceptions  referred  to  are  the  mean  scores  for 
the  "voicing"  and  the  "nasality"  attributes.  In  addition  to 
those  scores,  the  large  attribute  bias  score  for  "nasality"  is 
notable,  l.e.,  nasal  consonants  were  significantly  more  dis¬ 
tinguishable  in  NO  than  were  their  oral  counterparts. 

Tables  12,  13,  and  14  reveal  small  differences  in  the  various 
DRT  scores,  with  the  exception  of  a  depressed  attribute-present 
score  for  "nasality"  in  the  00  experimental  condition  (Table  2). 
This  decrement  in  the  discriminabi 1  i  ty  of  nasal  consonants  results 
in  a  decreased  attribute  mean  score  and  a  relatively  large 


TABLE  11.  Percent  Correct  Response  for  the  Nasal  Acoustic  Output  (NO). 
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TABLE  12.  Percent  Correct  Response  for  the  Oral  Acoustic  Output  (00). 
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TABLE  14.  Percent  Correct  Response  for  the  Output  of  the  Control  Condition. 
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negative  attribute  bias  score  for  "nasality"  in  the  00  condition. 

Differences  between  the  control  condition  and  each  of  the 
experimental  conditions  were  evaluated  by  means  of  "t"-tests,  the 
results  of  which  are  shown  in  Table  15.  This  table  does  not  show 
"t"s  for  the  attribute-present  or  attribute-absent  scores,  since 
that  information  can  be  determined  from  the  "t"s  for  the  mean 
and  bias  scores  (as  long  as  the  direction  of  the  bias  is  known). 

Table  15(a)  shows  thv°  results  of  "t"-te8t8  between  the  con¬ 
trol  and  the  00  experimental  condition.  The  mean  and  biaa  dif¬ 
ferences  for  "nasality"  are  significant  (p  <  .01),  while  all 
other  attributes  show  "t"s  less  than  1.0.  It  appears,  then,  that 
the  oral  cavity  produces  an  output  that  is  significantly  defi¬ 
cient  in  nasality  information,  but  nevertheless  retains  a  sub¬ 
stantial  amount  of  information  with  respect  to  the  state  of  this 
feature.  A  significant  difference  in  bias  indicates  that  the 
information  loss  occasioned  by  removal  of  the  nasal  component 
of  the  speech  signal  is  an  assymetrlcal  loss.  Predictably, 
greatest  loss  occurs  with  respect  to  the  positive  (i.e.,  nasal) 
state  of  this  feature.  On  the  other  hand,  the  output  of  the 
nasal  cavity  presents  an  entirely  different  picture 

Table  15(b)  reveals  the  NO  condition  to  be  substantially 
inferior  to  the  control  from  the  standpoint  of  overall  consonant 
discriminability.  The  nasal  output  is  deficient  in  inforiration 
with  respect  to  all  consonant  attributes,  as  seen  in  the  highly 
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TABLE  1!)  Results  from  Analyses  by  "t”-Tests  Between  Each 
of  the  Three  Experimental  Conditions  and  the 
Control . 


(a) 


(b) 


Consonant 

Attribute 
(Present /Absent) 

"t"  for 
Attribute 
Mean 

"t"  for 
Attribute 
Bias 

Voiced/Voiceless 

.47 

.26 

g  Nasal /Oral 

4.89 

3.64 

Sustained/Interrupted 

.80 

.98 

u  Sibilated/Unsibilated 

.55 

.24 

2  Grave /Acute 

.27 

.76 

Compact /Diffuse 

.56 

.71 

Voiced /Voice less 

8.22 

1.71 

o  Nasal /Oral 
ss 

8.36 

5.56 

Sustained/Interrupted 

14.44 

.70 

ij  Sibilated/Unsibilated 

21.30 

2.72 

5  Grave/Acute 

24.26 

.69 

Compact /Diffuse 

18.52 

.66 

Voiced /Voice less 

1.77 

.81 

^  Nasal /Oral 

1.82 

1.17 

^  Sustained/Interrupted 

1.99 

1.20 

S  Sibilated/Unsibilated 

1  i 

.00 

1.53 

o  Grave/Acute 

f  « 

1.53 

1.02 

Compact /Diffuse 

.61 

.84 

With  7  df,  P  ^  .01  for  "t"  >  3.50. 
With  7  df,  P  .001  for  "t"  ;  5.41. 
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significant  (p  <  .001)  "t"s  for  the  mean  diagnostic  scores. 
Moreover,  the  significant  bias  score  for  "nasality"  indicates 
that  a  l('..s,  albeit  an  assymetrical  one,  occurs  even  in  the  case 
of  the  feature,  nasality.  The  negative  (i.e.,  non-nasal)  state 
of  this  attitude  is  poorly  represented  in  the  nasal  signal. 

Finally,  Table  15(c)  presents  the  results  of  "t"-tests 
between  EM  and  control.  These  tests  revealed  no  significant 
differences  between  EM  and  the  control  in  any  of  the  attribute 
scores.  It  will  be  assumed,  therefore,  that  mixing  the  outputs 
of  the  oral  and  nasal  cavities  produced  a  signal  that  was  not 
significantly  different  from  the  control,  with  respect  to  con¬ 
sonant  discriminability . 
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DISCUSSh'N 

Since  the  Total  DRT  Score  represents  a  measure  of  speech 
intelligibility.’  These  scores  may  be  used  as  an  indicator 
of  the  relative  contribution  of  the  oral  and  nasal  outputs 
to  overall  speech  intelligibility.  The  Total  DRT  Scores 
for  the  NO  and  00  conditions  are  24.9%  and  93.8%  respectively. 
Predictably,  the  output  of  the  oral  cavity  makes  a  much  greater 
contribution  to  the  speech  communication  process  than  does  the 
nasal  output. 

The  00  condition  contained  sufficient  information,  rela¬ 
tive  to  the  control,  to  disci iminate  among  consonants  with  re¬ 
spect  to  all  attributes  except  "nasality."  Even  in  the  case  of 
"nasality,"  di <:crimination  of  the  absent  state  was  relatively 
unimpaired.  The  oral  cavity  output  was,  however,  deficient  in 
perceptual  information  with  respect  to  the  state  of  the  feature, 
"nasality."  On  the  other  hand,  the  NO  condition  contained  little 
of  the  information  necessary  for  consonant  discrimination  on  the 
basis  of  any  of  the  attributes  used  in  the  DRT.  In  fact,  only 
in  the  case  of  "nasality"  was  there  sufficient  inforn)ation  for 
reliable  discrimination  (49.6%,).  And  even  in  that  attribute  tlie 
discrimination  of  orals  from  nasals  was  only  25.4%  above  chance, 
while  the  inverse  discrimination  was  73.8%. 


Although  there  is  some  information  contained  in  the  nasal 
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output  for  all  the  consonant  attributes,  overall  speech  intelli¬ 
gibility  is  relatively  unimpaired  by  its  absence.  In  fact,  only 
in  the  case  of  the  attribute  "nasality"  and  only  for  the  discrim¬ 
ination  of  that  attribute's  present  state  does  the  nasal  output's 
contribution  to  consonant  discriminability  become  significant, 
i.e.,  the  absence  of  the  nasal  acoustic  output  (the  00  experi¬ 
mental  condition)  results  in  a  significant  decrement  only  in  the 
discrimination  of  the  nasal  consonants  (/mni]/)  from  their  oral 
cognates  (/bdg/). 

However,  the  fact  that  other  attribute  mean  scores,  in  addi¬ 
tion  to  that  of  "nasality,"  are  significantly  above  chance  per¬ 
formance  in  the  NO  condition  (Table  16)  is  somewhat  remarkable. 

It  seems  unlikely,  in  view  of  the  low  level  at  which  the  speech 
was  presented  to  the  crew  of  listeners,  that  this  NO  information 
is  simply  output  from  the  oral  cavity  that  was  not  completely 
attenuated  by  the  acoustic  shield.  If  such  were  the  case,  the 
NO  scores  would  be  the  result  of  high  frequency  distortion,  since 
the  acoustic  shield  served,  in  effect,  as  a  low-pass  filter,  as 
indicated  by  the  graph  of  Fig.  5.  However,  the  patterns  of  mean 
diagnostic  scores  and  bias  scores  obtained  under  the  NO  condi¬ 
tion  are  not  characteristic  of  those  which  have  been  found  in 
cases  involving  low-passed  speech,*  nor  do  the  patterns  parallel 
those  that  have  been  obtained  for  speech  presented  under  low 
signal-to-noise  ratios."  It  seems,  therefore,  that  the  attribute 


Table  16.  Results  from  Analysis  by  ”t”  Test  for  the  NO  Experimental 
Condition  (Significance  of  Attribute  Scores  with  Respect 
to  Chance  Performance) . 
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scores  that  differ  signlflcanCly  from  chance  in  the  NO  condition 
are  not  artifactual,  but  rather  that  they  result  from  the  actual 
presence  of  perceptual  discriminatory  Information  in  the  output 
of  the  nasal  cavity. 
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rummary 

Recordings  of  Form  IV  of  the 
Diagnostic  Rhyrje  Test  by  six  male 
speakers  were  used  to  evaluate  the  per¬ 
formance  of  a  sample  of  digital  vocoders, 
all  operating  in  the  neighborhood  of 
2A00  bps.  The  results  are  compared  to 
those  of  the  1967  survey  and  to  the  case 
of  noise  masked  speech.  Specific 
strengths  and  weaknesses  of  the  "t 'pica I 
vocoder"  of  1972  are  discussed. 

Introduction 

Tiie  purpose  of  this  report  i.s  to 
attempt  to  characterize  the  performance 
of  present-day  digital  vocoders  from  the 
standpoint  of  speech  intelligibility. 
Ideally,  it  would  serve  as  a  sequel  to  a 
similar  report  generated  by  the  survey 
conducted  in  conjunction  with  the  1967 
Speech  Conference* ,  end  thus  permit  an 
evaluation  of  the  advances  in  digital 
vocoder  technology  that  have  occurred 
during  the  past  five  years.  Regrettably, 
several  factors  converged  to  preclude 
such  an  evaluation  on  any  reasonably 
controlled  basis. 

The  situation  is  complicated  first 
by  the  fact  that  only  one  of  the  systems 
evaluated  in  the  previous  survey  was 
available  for  evaluation  in  the  present 
survey.  In  addition,  the  sample  of  pitch 
excited,  digital  vocoders  available  for 
purposes  of  the  present  survey  was  even 
smaller  than  the  sample  used  in  the  pre¬ 
vious  survey.  Among  these,  moreover,  one 
was  clearly  malfunctioning  to  a  degree 
that  warranted  its  exclusion  from  the 
survey.  Another  factor  which  complicates, 
but  does  not  in  itself  preclude,  compar¬ 
isons  was  the  use  of  a  different,  albeit 
improved,  version  of  the  Diagnostic 
Rhyme  Test,  DRT  Form  IV*.  On  the  positive 
side  are  the  more  refined  evaluations 
permitted  by  the  current  version  of  the 
DRT,  and  by  the  use  of  multiple  speakers. 


ore  of  whom  served  as  the  single  speaker 
used  in  the  earlier  survey. 

Other  things  equal,  DRT  Form  IV 
tends  to  yield  somewhat  lower  scores  than 
the  DRT  Form  III  used  in  the  previous 
survey.  However,  resi’lts  obtained  »rlth 
this  form  can  be  rather  easily  translated 
into  the.r  Form  Til  equivalents.  For 
example,  half  of  the  items  used  in  Form  IV 
to  test  the  apprehensibility  of  the 
attribute  sustention  inv’olve  voiced  conso¬ 
nant  pairs,  while  half  involve  unvoiced 
pairs.  These  prop.'>rt Lors  ire  different 
in  the  c.«se  of  Form  III,  where  unvoiced 
consonant  pairs  predominate.  Since 
susi  eatir  n  tend.-;  geneiaJly  to  be  more 
apprehensible  in  tinvoiced  pairs,  DRT  111 
typically  yields  higher  scores  on  the 
sustention  scale  than  DRT  IV.  However, 
by  appropriately  weighting  listener 
performance  on  voiced  and  unvoiced  pairs, 
sustcntio.n  scores  on  one  form  of  the  DRT 
can  be  translated  into  their  equivalents 
on  the  other.  Similar  adjustments  can 
also  be  made  in  the  case  of  scores  for 
voicing  (where  friction  is  the  condition¬ 
ing  factor),  graveness  (where  difficulty 
is  conditional  upon  the  state  of  voicing 
and  "plosion"),  and  so  on. 

Methods  and  Materials 

For  purposes  of  this  investigation, 
six  male  speakers  recorded  four  complete 
sets  (192  test  words  each)  of  the  DRT  IV 
materials.  These  were  randomly  combined 
into  four  master  tapes,  each  of  which 
contained  a  recording  from  all  six 
speakers.  These  were  randomly  assigned 
to  the  various  entries  rn  the  survey 
(which  included  systems  other  than 
digital  voc.iders),  but  with  the  restrict¬ 
ion  that  all  representatives  of  a 
definable  class  of  systems  (such  as 
pitch  excited  digital  vocoders)  received  . 
copies  of  the  same  master  tape.  The 
output  recordings  from  all  entries  were 
presented  in  random  order  to  a  crew  of 
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•Ight  highly  selected  (for  stability  of 
performance)  and  experienced  listeners. 
This  order  was  reversed  end  all  materials 
were  presented  a  second  time  to  the  same 
crew. 

All  test  materials  were  presented 
dlotlcally  at  an  SPL  of  approximately 
72  dB.  Proprietary  considerations  pre¬ 
clude  disclosure  of  the  exect  number  and 
Identities  of  the  systems  Involved. 

Results 

It  may  be  of  interest,  first,  to 
compare  the  performance  of  the  present 
sample  of  vocoders  with  that  of  the 
vocoders  evaluated  in  the  previous  survey. 
For  this  purpose,  only  data  for  the 
single  speaker  common  to  the  two  surveys 
are  used.  The  averages  of  the  major 
diagnostic  scores  yielded  by  the  present 
sample  were  translated  into  their  DRT  III 
equivalents.  They  are  presented  in 


Table  17 . 

Table !7. 

Equivalent  DRT 

III  Scores 

for  Three 

Conditions 

Diagncstic 

Scale 

Condition 

Vo 

Na 

Su 

Si 

Gr 

Co 

Av 

Typical  Dig. 
Vocoder 

97 

98 

82 

97 

89 

93 

93 

1967 

(DRT  III) 

Typical  Dig. 
Vocoder 

95 

97 

83 

99 

82 

94 

92 

1972 

(DRT  III  equiv.) 


From  the  table,  ^  can  only  conclude 
that  the  "typical"  digital  vocoder  of 
1972  differs  negligibly  fnm  that  of  1967 
when  evaluated  on  the  basis  of  essentially 
the  same  criteria.  The  average  DRT  total 
score  of  the  present-day  sample  falls  one 
point  below  that  of  the  1967  vocoder. 

This  result,  however,  merits  only  the 
most  qualified  acceptance,  in  view  of 
degree  of  intervocoder  variation  that 
characterized  both  samples.  In  both  1967 
and  1972,  total  scores  spanned  a  range  of 
over  three  points.  The  addition  or  exclu¬ 
sion  of  a  single  case  from  either  sample 
could  easily  tilt  the  balance  in  favor  of 
one  or  the  other.  Finally,  some  allowance 
must  of  course  be  made  for  inadequacies 
In  the  procedure  used  for  converting 


DRT  IV  results  to  their  DRT  III  equiva¬ 
lents.  Although  different  listener  crews 
were  used,  this  factor  would  appear  to  be 
of  negligible  consequence.  When  the 
present  crew  was  used  to  evaluate  sample 
tapes  from  the  1967  survey,  differences  in 
total  DRT  scores  were  typically  of  the 
order  of  .1  percent. 

Table  le  presents  the  average  of  the 
unadjusted  diagnostic  scores  yielded  by 
the  present  sample  of  vocoders.  For  pur¬ 
poses  of  comparison,  corresponding  scores 
for  the  case  of  noise  masked  speech 
(6  dB  S/N  ratio,  8  KHz  passband)  are  also 
presented.  The  standard  errors  shown  in 
this  table  are  derived  from  mean  scores 
for  speakers  rather  than  listeners,  since 
the  former  constitute  the  more  important 
source  of  variation  in  test  results. 

Table  le  .  Gross  DRT  IV  Diagnostic 
Scores  for  the  Typical  Vocoder 
and  for  Noise  Masked  Speech 


Condition 


Score 

X* 

Vocoded 

Speech 

s.e.** 

5c* 

Noise 

Masked 

s.e.** 

Voicing 

86 

3.2 

94 

1.0 

Nasality 

96 

1.5 

98 

0.6 

Sustention 

73 

2.5 

76 

2.9 

Sibilation 

96 

1.4 

95 

1.2 

Graveness 

77 

1.9 

74 

2.4 

Compactness 

93 

0.8 

90 

0.9 

Average 

89 

1.2 

88 

0.7 

^Averages  for  six  speakers 
**Based  on  speaker  averages 


From  the  table,  it  appears  that  the 
effects  of  vocoding  upon  speech  apprehen¬ 
sibility  are  grossly  quite  similar  to 
those  of  noise,  where  the  two  conditions 
yield  approximately  the  same  overall  level 
of  speech  apprehensibility.  In  any  case, 
such  differences  as  appear  here  cannot 
be  safely  generalized  to  the  population  of 
male  speakers  at  large. 

Table  le  provides  a  more  detailed 
analysis  of  the  "typical  vocoder"  of  1972. 

Shown  in  the  table  are  averages  of 
the  six  major  diagnostic  scores  for  the 
vocoders  in  the  pi osent  sample.  Various 
components  of  eac-b  of  these  scores  are 
also  shown.  For  cxamole,  the  voicing 
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Table  Conplete  Diagnostic  Scores  for  the  Typical  Digital  Vocoder 


Attribute 

Pos.  State 

Nag.  State 

Bias 

S^.g 

Average 

^•A 

Voicing 

83.5 

88.8 

-5.3 

4.93 

86.1 

3.18 

Frictional 

72.3 

80.0 

-7.7 

9.60 

76.1 

6.24 

Nonfrictional 

94.7 

97.6 

-2.9 

1.94 

96.2 

1.04 

Nasality 

94.3 

96.9 

-2.6 

1.64 

95.6 

1.51 

Grave 

91.6 

95.3 

-3.7 

2.10 

93.5 

2.94 

Acuta 

97.1 

98.5 

-1.4 

1.66 

97.8 

.56 

Sustention 

73.7 

71.6 

2.1 

2.59 

72.7 

2.49 

Voiced 

68.6 

61.0 

7.6 

6.18 

64.8 

4.01 

Unvoiced 

78.9 

82.2 

-3.3 

7.66 

80.6 

3.03 

Sibilation 

94.5 

97.6 

-3.1 

2.00 

96.1 

1.38 

Voiced 

90.8 

97.1 

-6.4 

3.56 

93.9 

2.08 

Unvoiced 

98.3 

98.1 

.2 

.68 

98.2 

.73 

Graveness 

73.5 

79.7 

-6.2 

6.11 

76.6 

1.91 

Voiced 

81.5 

88.3 

-6.8 

5.28 

84.9 

2.62 

Unvoiced 

65.6 

71.1 

-5.5 

8.76 

68.3 

1.58 

Plosive 

82.7 

88.6 

-5.9 

7.78 

85.6 

2.30 

Nonplosive 

64.4 

70.8 

-6.4 

5.80 

67.6 

3.92 

Compactness 

95.2 

91.5 

3.6 

1.72 

93.4 

.76 

Voiced 

97.6 

96.1 

1.5 

.60 

96.8 

50 

Unvoiced 

92.8 

87.0 

5.8 

3.58 

89.9 

L.45 

Sustained 

97.7 

92.8 

4.8 

2.58 

95.2 

1.29 

Interrupted 

92.7 

90.2 

2.5 

1.64 

91.5 

.66 

B/M 

95.5 

94.7 

.8 

1.16 

95.1 

.66 

B/F 

94.9 

88.4 

6.4 

4.00 

91.6 

1.39 

score  is  broken  down  into  two  components 
representing  the  apprehensibility, 
respectively,  of  the  positive  and  nega¬ 
tive  states  of  this  attribute.  It  is 
broken  down  additionally  into  two 
components  representing  the  gross  appre¬ 
hensibility  of  voicing  in  frictional 
(Inclviding  affricates)  and  nonfrictional 
consonants  respectively.  Further  scores 
are  provided  for  each  state  of  voicing 
in  each  of  these  two  cases.  Values  in 
the  "bias  column"  indicate  the  degree  tu 
which  listeners  favored  the  positive 
states  of  the  various  attributes .  The 
standard  errors  for  bias  and  total  scores 
are  in  all  cases  based  on  speaker  means 
and  thus  provide  indications  of  the 
susceptibility  of  tne  various  scores 
differences  ir  speaker  character i stit :  . 

Although  few  of  Chr  trends  s.ugv.r :;!  r-d 
by  tnese  results  are  statistically 
signif i -rant ,  several  are  worthy  of 


particularly  as  they  coincide  or  fail  to 
coincide  with  trends  observed  under  other 
circumstances.  There  is,  for  example,  a 
rather  strong  indication  that  voi ring  is 
less  apprehensible  in  frictional  conso¬ 
nants  than  in  nonfrictional  consonants. 
This  trend,  which  also  characterizes 
unprocessed  speech  in  moderate  levels  of 
noise,  was  evident  for  all  six  speakers 
in  the  present  case.  The  inflated 
standard  error  for  the  frictional  case 
derives  in  fact  from  the  extreme  degree 
to  which  this  trend  was  associated  with 
one  of  the  speakers.  The  negative  bias, 
which  appears  here,  is  not  significant, 
nor  is  It  in  the  case  of  noisy, 
unprocessed  speech. 

The  negative  average  bias  shown  In 
Lht;  case  of  -.asali tv  is  not  sienifican" 
no’’  i.s  it  consistent  with  results  for 
other  transmission  conditions. 
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On  Ch*  average,  listenera  in  this 
Invaatlgaclon  tmv  consistently  able  to 
apprehend  the  state  of  sustention  more 
rallc.bly  for  unvoiced  phonemes  than 
voiced.  This  trend  was  observed  only  for 
five  of  the  six  speakers  in  this  case, 
but  is  generally  observed  in  the  case  of 
noisy  speech. 

Sibilation  appears  to  be  somewhat 
lass  apprehensible  in  the  voiced  than  in 
the  unvoicad  case  for  the  present  sample 
of  vocoders.  This  trend  is  evident  for 
all  six  speakers  and  is  also  found  in  the 
case  of  noisy  speech.  Results  for  five 
of  the  six  speakers  reveal  a  slight 
negative  bias  in  the  case  of  sibilation. 
This  bias  is  generally  pronounced  in  the 
case  of  noisy  speech. 

Although  the  results  in  Table 
suggest  a  rather  consistent  negative  bias 
in  the  case  of  graveness .  this  tendency 
was  not  associated  with  all  six  speakers. 
No  such  bias  is  evident  in  the  case  of 
moderately  noisy  speech  although  a  pro* 
nounced  positive  bias  is  found  in  cases 
involving  higher  noise  levels.  The 
apprehensibility  of  graveness  clearly 
varies  from  voiced  to  unvoiced  phonemes 
and  from  plosive  to  nonplosive.  These 
tendencies  are  evident  under  virtually 
all  transmission  conditions,  and  derive 
in  part  from  the  fact  that  the  unvoiced, 
nonplosive  pair,  /f-d/,  is  involved  in 
four  of  the  most  difficult  items  of  the 
DRT  IV. 

No  significant  biases  are  evident 
in  the  case  of  compactness .  but  the  source 
state  of  this  attribute  proves  consis¬ 
tently  to  be  more  apprehensible  in  voiced 
than  in  unvoiced  phonemes.  In  vocoded 
speech,  compactness  appears  to  be  equally 
apprehensible  in  sustained  and  in  inter¬ 
rupted  phonemes.  However,  it  is 
consistently  more  apprehensible  in 
sustained  phonemes  in  the  case  of  noisy 
speech. 

The  back-middle  distinction  appears 
slightly  less  difficult,  on  the  average, 
than  the  back-front  opposition,  in  the 
case  of  vocoded  speech.  This  trend  is 
not  evident  with  all  speakers  nor  is  it 
found  in  the  case  of  noise  masked  speech. 

It  has  often  been  observed  that 
intelligibility  test  scores  depend  signif¬ 
icantly  on  the  characteristics  of  the 
speaker  Involved  and  some  degree  of 
speaker  dependence  was  evident  in  the 
present  case.  Table  ao  presents  average 
diagnostic  scores  for  each  of  six  speaker^ 
used  in  this  investigation.  In  the  table. 


the  speakers  are  ordered  with  respect  to 
average  pitch  frequency.  Some  correlation 
between  pitch  frequency  and  various  DRT 
scores  is  evident  and.  although  the 
present  sample  is  insufficient  for 
purposes  of  generalization,  we  have 
consistently  observed  this  trend  with 
larger  samples  of  speakers.  Other  things 
equal,  low-pitched  speakers  yield  higher 
DRT  scores  than  high-pitched  speakers 
on  pitch  excited  vocoder  systems. 

Although  this  tendency  is  evident  to 
some  degree  in  several  diagnostic 
dimensions,  it  is  most  pronounced  in  the 
case  of  voicing.  Here,  moreover,  there 
are  pronounced  speaker  differences  in 
characteristic  bias.  Low-pitched  speakers 
tend  to  induce  a  positive  bias  in  the 
case  of  voicing  while  high-pitched 
speakers  are  consistently  associated 
with  negative  biases.  Although  there 
were  minor  differences  in  the  ordering 
of  speaker  averages  from  one  system  to 
the  next,  in  no  case  did  a  score  for  a 
high-pitched  speaker  exceed  that  of  a 
low-pitched  speaker. 

Table  so.  Diagnostic  Scores  for  Six 
Speakers  (Average  for 
all  Vocoders) 


Diagnostic  Score 


Speaker 

Vo 

Na 

Su 

Si 

Gr 

Co 

Av 

CH(LP) 

93 

98 

76 

98 

81 

93 

90 

BV(LP) 

93 

97 

72 

95 

81 

96 

90 

RD(IP) 

92 

97 

80 

98 

75 

94 

90 

BL(IP) 

74 

95 

69 

99 

78 

94 

85 

JE(HP) 

82 

88 

63 

97 

78 

93 

83 

SN(HP) 

83 

98 

76 

90 

68 

90 

84 

The  range  of  speaker  averages  for 
individual  systems  varied  between  six 
and  nine  percentage  points  and  it  is 
conceivable  that  some  such  indicant  of 
system  versatility  could  prove  to  be  of 
value  as  a  supplementary  criterion  of 
system  performance.  Further  research  on 
this  issue  is  needed,  however. 


Conclusions 


In  conclusion,  Che  Cyplcsl  digital 
vocoder  of  1972  appears  grossly  Co  affect 
speech  apprehension  In  much  Che  same  way 
ea  bend-llmlced  Gaussian  noise.  As  In 
1967,  voicing,  sustention  and  graveness 
constitute  the  phonemic  dimensions  In 
which  Che  greatest  opportunities  for 
Improvement  exist.  It  Is  evident  that 
.the  present-day  vocoder  does  not  do  all 
things  equally  well  when  operating  In 
the  voiced  and  unvoiced  modes.  In 
general.  It  would  seem  to  preserve 
Information  as  to  type  of  articulation 
most  effectively  in  the  unvoiced  state; 
place  of  articulation  most  effectively 
In  the  voiced  state.  It  Is  also  evident 
that  present-day  vocoders  do  not  perform 
equally  well  for  all  speakers.  Low- 
pitched  speakers  tend  to  yield  higher 
scores  than  high-pitched  speakers  and 
other  speaker  factors  will  undoubtedly 
emerge  from  the  results  of  further 
research  on  this  issue. 
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Research  Activities 

Approximately  half  of  the  effort  devoted  to  this  project 
was  directed  to  the  er>H  of  developing  and  validating  improved 
methods  of  evaluating  speech  communication  systems  from  the 
standpoint  of  intelligibility.  This  effort  culminated  with 
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the  development  and  validation  of  the  Diagnostic  Rhyme  Test 
Form  IV  (DRT-IV).  It  also  occasioned  research  on  a  diversity 
of  subjects  in  the  area  of  speech  perception,  and  several  of 
the  projects  undertaken  yielded  results  of  general  practical 
and  theoretical  interest. 

In  addition  to  the  design  and  validation  of  DRT  IV  itself 
were  studies  of  individual  differences  in  speech  perception, 
studies  of  speaker  differences,  a  study  of  the  information 
content  of  the  nasal  output,  and  a  comparative  evaluation  of 
present-day  speech  communication  and  processing  devices,  as 
reported  in  Chapters  1-5. 

Testing  Services 

Pursuant  to  the  provisions  of  the  contract,  a  series  of 
Diagnostic  Rhyme  Tests  were  performed  on  tapes  of  experimentally 
processed  speech  materials  supplied  by  the  contract  monitor. 
These  included  among  others  output  tapes  from  the  various  speech 
communication  and  processing  systems  submitted  for  evaluation 
in  conjunction  with  the  1972  Conference  on  Speech  Communication 
and  Processing  held  at  Newton,  Mass.,  under  the  joint  sponsor¬ 
ship  of  the  Air  Force  Cambridge  Research  Laboratories  'nd  the 
Institute  of  Electrical  and  Electronics  Engineers,  Inc. 

Software  Development 

Analysis  data  yielded  by  the  Investigative  phases  of  the 
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program  necessitated  the  development  of  a  series  of  successively 
referred  computer  scoring  programs  for  use  with  the  Diagnostic 
Rhyme  Test.  Such  programs  make  feasible  a  variety  of  scoring 
refinements  in  the  routine  use  of  the  DRT  for  purposes  of  system 
evaluation.  Programs  developed  for  use  in  this  project  were 
also  modified  to  permit  their  use  with  computer  systems  other 
than  those  available  at  TRACOR.  Appendix  II  contains  the  basic 
DRT  IV  scoring  program  and  a  sample  printout. 

Tape  Recordings 

The  investigations  performed  under  the  contract  necessitated 
the  assembly  of  an  extensive  library  of  recorded  speech  mater¬ 
ials.  This  library  included  recordings  of  DRT  III-A  materials 
and  samples  of  continuous  speech  for  80  male  speakers.  These 
served,  among  other  things,  the  purposes  of  research  which  led  to 
the  development  of  Form  IV  of  the  DRT.  Recordings  of  DRT  IV 
materials  were  also  made  by  a  number  of  speakers.  These  were^ 
used  for  purposes  of  research  and  testing  during  the  later  stages 
of  the  project.  They  also  provided  the  basic  test  materials  used 
in  the  survey  of  speech  processing  and  communication  systems  con¬ 
ducted  in  conjunction  with  the  1972  Conference  on  Speech  Communi¬ 
cation  and  Processing.  All  master  recordings  were  delivered  to 
the  contract  monitor. 


APPENDIX  I 


FORTRAN  MAIN  ROUTINE  AND  SUBROUTINE  LISTINGS 
FOR  DRT  IV  COMPUTER  SCORING  PROGRAM 


FORTEIAN  Main  Routine  and  Subr  <  tine  Listings 
for  DRT  IV  Computer  Scoring  Program 
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I* 

*f  • 

b* 

*• 

7« 

6« 

9* 
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1  1  6 

12# 

13# 
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IH* 

9001 

ISa 
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120 

176 
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I2| 

196 
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2|6 
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296 

2S6 

266 

126 
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2B6 

296 

306 

BSC 

3|6 

326 

336 

396 

lOl 

3b6 

366 

376 

102 

386 

396 

103 

HU. 

m  ( 

9l6 

926 

936 

996 

6S6 

946 

H/6 

300 

986 
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H96 

«iU6 

Sl6 

301 

826 
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J2P*0t>0 
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70« 

J2P4GE-1 
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J3P4GE41 

72* 
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7*'« 
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7S* 

NNaO 
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77. 
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■  0# 
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1  |04 
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1124 
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1134 

IF ( J2PAGE.E0. 1 1  call  FIN|I 

1194 

IFIj3PAGE.EO.OI  CALt  FINIS 

1 1S4 

1  IS 

CONT INJE 

1144 

CALL  ERFOR 

1174 

IF( lBIb<OT.OI  CALL  BIGIO 

1184 

ifijia.gt.oi  call  itpanl 

1194 

IFIJIA.lt. 21  GO  TU  119 

1204 

00  118  |4  1  ,  1  12 

1214 

DU  IC1<  J>l .9 

1224 

1018 

IToni 1 . Jla|TIH( 1 ,JI 

1234 

00  1019  ja|,20 

1294 

1017 

IASI  1 , J|4 IXS8I  1 . Jl 

12b4 

1  18 

continue 

1244 

CALL  irllANL 

1274 

1  19 

CONT INuE 

1284 

if(jpu’<ch.ec.2i  call  punch 

1  294 

IF  ( JTTtST.GT.OI  CALL  TTST 

1304 

104 

CONTINUE 

1314 

GO  To  1C9 

1324 

107 

CUNT |NuE 

1334 

C 

1394 

108 

(URHaT  (lOA.OIO.SX.OlC.SX.rlO.SAtOlOl 

13S4 

109 

FORMAT  lIJ'-.l'A.irill 

1  144 

lie 

FUHhat  lrA.l2<R<<(^10tS7<0l0.Sx.0IC.SF.CICI 

1374 

1  1  1 

FOHMlT  l|H,2l,3A6) 

1  384 

1  12 

fOMMAT  I13A6I 

1394 

1  1  3 

f uhha  r ( io( 06 , 1 > 1 1 

1904 

EnO 

101 


1  • 


10* 

1  *  • 

12* 

13* 

19* 

IS* 

1*9 

1 

IT* 

ta* 

|9* 

2 

20* 

21* 

22* 

23*' 

29* 

2S* 

3 

2** 

27* 

10 

2a* 

29* 

30* 

31* 

32* 

1* 

33* 

39* 

3S* 

3** 

37* 

1  1 

3** 

20 

39* 

12 

90* 

91* 

IS 

92* 

93* 

99* 

9S* 

9** 

97* 

98* 

^Un><0UT|KL  iilGlU 

C0n«<0Ki/«LL/C03t  <  ISSI  .SLL  (2CI  .No  •  NU  t  N  a  ,N  w  •  JT  T  t  S  T  •  XDl  , -^ASC  Ux  ,JPi,;.Lr. 

1  .NH.J*«C.mJ6.J&P«.iaPilOI  ,  I^A«E  (230  I  .K'ATC  (20  I 
COMNON/tSH/riSk^ (2C» . IL(2:.7I .ll(2Ci7),tD(2Ct7).lT(20.7i 
1 t IUU(2a, ISC  > . • 'LP( 1121 

CONNON/Mn/KSPL(  II  .2.2.2,21  .INRO I  1 1 2 . 3  I  .LOBLE  ( «  .6  I  .  1  TON  ( 1 1 2  .N  I  .  1  «S 
l(ll2,2Jl 

OINENSION  IBI6(ISI.ialbP||Sl.Bl(.(ISl 
DJ  2  KBl.lS 
lB|6IKia|TEN( 1 ) 

ISiePI. ial 
DO  I  1*2. 112 

iP(  1BI(.(KI  .GT.  ITCn(  I  I  1  GO  TO  I 

lalGlk (■ITENi  1  I 

IdlGPIxlal 

continue 

JaieiGPIKI 
ITEMi Jl-O 
continue 
TOTaNQ.fiLxjAVE 

1FIJSPK.ME.0I  TOT>Na«JAVC»jSPK 

00  3  Ka|  .  IS 

IaiaiGP(K| 

ITCH(II*IB1G(KI 

aiGlKI-l IT0T-2«1B16IK1 I /tot  I *100.0 

print  10 

FURNaT I |M1 ,9X ,S6MFCH  THE  PURPOSES  OF  FonThER  RESEARCH  OESlGNEO  To 
ilnPR0VE./.l2x.60MTCUH  STSTEH  UR  DEVICE.  TOO  mILE  FIND  IT  ADVaNTAuC 
20US  TO  G1 VE./ . I 2X ,73hSPEC I AL  ATTENTION  TO  THE  0 1 S T I N&U t Shab i L I T I  U 
RF  THE  FOLLOAInG  RORO  PAIRS.*  I 

PRINT  I& 

format  (lAX.lOHkORD  PAIRS  .l7X.RHPICi  /> 

00  I  I  I> I  ,  10 
J«IBI6P( I  I 

PRINT  12 t ( INRDI J.K I .K*! ,3 1  ,B|G|  I  I 
IF(BIG( I I.GT. 99.999999)  GO  TO  20 

continue 

Continue 

fORHAT  ( t*X.3AA.NXtF|0.l ./) 

print  is 

format  (/,|0x,«**  the  contrasts:  faD-tmao.  fin-Thin,fouu«t-Th><ug 
INT , • ./ . I 2X , • VON-eO\ ,  VOX>BOX,  vEC-GEE.  VlLL-BlLE,  VAULT-FAULT  • 
2./,  I2X,  SSh.Re  SENeRalLT  AHOUNG  ThI  most  „I 

SFFlCULT  TO  0  I  ST  I  NGu  I  Sm  .  /  ,  |  2  A  ,  7  rH  Thl  |  u  PRESENCE  On  Tnt  FORtGO|Nf,  Ll 
7ST  DOES  NUT.  THEREFORE.  REFLECT  UN  I OuEL T . / . 1 2X  .  NAHUPON  TmL  PEmForm 

9ance  of  tour  ststlm  ok  device.  I 
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END 


1  * 
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2* 
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3* 
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9* 

1 
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s* 
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** 

JXaJX- 1 

7* 

IX*I 

a* 
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9* 

IPOP«A  1  I  X  ,  1  1 
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11* 

end 

( 1 1  Jl 


gO  TO  1 

JX  » 


19 

2* 

3a 

9* 

s* 

A* 

7* 

«• 

9* 

|0* 
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2» 
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*!• 

&• 

4* 

7* 

•  • 

«• 

|D* 

1  !• 

J3» 

»••• 

IS* 

14* 

17* 

18* 

I»«  I 
20* 

21* 

22*  2 
23* 

2‘t*  30 

2S* 

24* 

27* 

28*  3 

28*  8 

30* 

31* 

32*  S 
33* 

38* 

3S*  4 

34* 

37* 

38* 

38*  7 

80* 

81*  8 

82* 

83* 

88* 

8S* 

84* 

87* 

88* 
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SO* 

SI* 

S2* 

S3, 

S8, 

SS* 
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S8* 
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4S* 
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CODE  C4  1*81, 

1L4U ILL ,4 1*0 
CONT IHUC 
DO  S  1*1 ,8 
DO  S  J*l ,8 
IAN44I t,Ji«0 
DO  4  0*1,112 
ITEH|JI*C 

continue 

|NC*1 

IV*-1 

GO  To  * 

l*tC*-l 

I  V*-2 

continue 

DO  23  XT*1 ,ja«E 

IF  ijpu'<ch.ne.oi  call  rating  IIVI 

00  23  40*1  ,N0 
DO  22  LL*1 ,Nl 
00  22  “JL*  1  ,7 

Read  24,  K0OC,|l-,|PAGE,NKcr,|lo87A(j|,j*l,S4l,lANS,ISHeCT 

1 ANS*I 4NS* 1 

I  Sheet* I  Sheet- IRA* I 

Ians* I ll*NE*8)-8|*(( I SHEET* 1  I /2  » 

IF  I ISAVE INKET I ,NE,GI  N4C7* ISA V£ I NKE 1 1 

ie*HOOINKEV,NOl 

IFIIO.rQiDI  lO'NO 

C0DC|Krl*400C 

IFIJSP4,LU.0)  |iI*IRT*NO-NS|*|Q 

IFUSPIl  74,77,74 

IL»-Il 

IL4*|SUBI  ILI 
NSuBI ILX la  IL 
lL*lL4 
3J*0 

IF  iHOUl ISHEET  ,2  )  .te,UI  JJ*S4 

DO  22  N*  I  ,8 

NH*N 

IF  lHO':i  l5HEET,2t,ES,0l  r.H,N*a 
DO  22  <*l  ,44 
J,  (  1  Na'.A  I 


AM* 

A9a 

7U* 

7  1  • 

72* 

9 

73* 

10 

79* 

1  1 

75* 

7A* 

77* 

76* 

79* 

60* 

12 

61* 

13 

62* 

83* 

69* 

19 

65* 

66* 

67* 

66* 

69* 

90* 

IS 

91* 

16 

92* 

93* 

99* 

95* 

96* 

17 

97* 

16 

96* 

19 

99* 

100* 

101* 

102* 

103* 

109* 

105* 

20 

106* 

107* 

108* 

109* 

110* 

111* 

1  12* 

1  13* 

119* 

115* 

21 

116* 

117* 

22 

1  18* 

23 

1  |9* 

120* 

121* 

122* 

123* 

29 

129* 

125* 

126* 

127* 

1  2H* 

25 

129* 

130* 

26 

131* 

I  ntH»  j*jj 

«L  I  Nit«lUTeH*27. 01/28.0 

I  IPOP (  I «NiX (  UNb ,KLIN' ) , J( .10. t I  |U*T*|J)«J-I0A1*(JI 
bO  To  t  10.91  .  iPAbL  1 

iO*T«(j|a3>|0*T« ( J) 

IF  I |D*I *IJ I- I IPOP UCTINKLY .KL|NK I . Jl* I ) I  19,22.11 

tLIAPI|L.Kl9|LF*PllLiKI*|NC 

Lbanooi lU.NO) 

IFtLg.Lb.OI  L0*NQ 

ITIHI J*JJ,Lgi«tT|M| J*JJ,L0)*|NC 

ixseij*JJ. iLi«|xsaij*jj, iLi* INC 

IJa  I 

<iO  TO  (t:.IJ.I3.li.l9.IS.I7i.K 
L»1P0PI1  ?FET(iI» 

ISPLTIK. IL.L,|J)«1SPLT(K, IL.L. IJ|9|NC 
60  TO  |8 

t"|P0PI  ISPKEriF)  .N>.1  1 

ISPLTIK • IL ,L .IJ I■ISPLT|K , |L.L,IJI*INC 

KKbK*1 

L«1P0PI 1SPKET1<KI,MMI*1 

ISPLTIKK, tL.L.tJ)>lSPLTiKK,IL.L.lJI*|NC 

60  To  (8 
«KaA 
KKsKK* I 

La 1 POP  I  ISPKETIKKI 

ISPLTIFK, IL.L. iJIaiSPLTIKK. IL.L.IJ>*|Nc 
IF  IKK.LT.9t  GO  TO  i« 

60  TO  18 
continue 

IF  INASCOH-KI  21.20.20 
lLX««(IL.K)aIt.>A*ltL.KI*|NC 
LQaHOOl 10, NO) 

IFILQ.LQ.OI  LUaNQ 
IT  IHIJ.JJ.LOla IT 1M|J*JJ,LQ|-INC 
|XSB(J«JJ. ILIalKSUI J*JJ, ILI-iNc 
IJa2 

60  TO  12 

lLIU(IL,10la|i.X(tllL, 161*100 
JT*aH0r)IJ.8) 

IFIJTX.EQ.OI  JTXatl 

lLXVIlLiJTxla|LXV(lL,JTX>*|Nc 
IFIJIA.EO.O)  GO  To  2| 

INKaiNC 

LUanoo I  I u  ,N6 I 

I  P  I  LO.E  6  •  0  I  LOa'.g 

IT0N(J*JJ,L6)at  rOM|j«Jj,l.(j|*||^H 

lXSIJ*JJ,ILIalxS(J.JO,|L)«(NK 

ITEN(J*JJ|aITCN(J*Uj|*INC 

IGRSIKt la|g»si KT 1. INC 

continue 

continue 

IP  I  C J< PEST.GT .0  I .AND. 1 INc.EO* I  > )  60  To  7 

00  25  1*1, NL 
00  29  ja| ,NA 

lLXATII.J)a||.AAP||,JI*lLXAAll.j) 

ILXABI  I  .JlaUAAPll.Ji.lLXAAII.Ul 
00  25  U* I ,9 
DO  25  f-Pa|,2 

ISPLT  <J.I.NP,3ia|SPcT(J,|,nP,|)-|SPLTIJ,I,NP,2l 
ISPLT  CJ,I,NP,9|alSPLTtJ,l,NP,I)*ISPLTCJ,t,NP.21 
Continue  * 

return 

PORMaT  <R9.I2.I1,I2,2*.20I  |  ,1X,28II  ,|OX,I|  ,Rl| 


I  * 

a* 

3* 

9a 

Sa 

*•  b 
7* 

8*  A 
9#  10 

lOa 

I  I* 


5UbR0UTII.L  ITIIAL 

COMMON/ I TM/K5PLI  1 1 .2.2.2.2  1 . INRDI I  12,31 .LUPLE 19 ,61 .ITOMIiij.nI.IxS 
11112,201 
DO  10  1*1  ,1 12 
CU  5  jal .20 
laSll.JIaO 
DIIA  J"  I  • 

I  TOP  I  I , J I ac 
CONTINUE 

return 

1 
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t* 

2« 

3* 

H* 

&• 

*• 

7* 

a* 

9* 

10* 
>  i* 
|2« 
13* 

It* 

IS* 

la* 

17* 

la* 

I9i 

20* 

21* 

22* 

23* 

2‘t* 

25* 

2a* 

27* 

2a* 

2f* 

30* 

31* 

32* 

33* 

3*** 

3S* 

3a* 

37* 

3a* 

39* 

90* 

91* 

92* 

93* 

99* 

9S* 

9a* 

97* 

98* 

99* 

SO* 

SI* 

S3* 

S3* 

S9* 

ss* 

S6* 

S7* 

sa* 

S9* 

ao* 

ai* 

a2* 

a3* 

a9* 

as* 

aa* 

a7* 

aa* 


SUBHOUTIM  EKNoA 
It.TECCrt  CODE 

C0»tM0»l/ALL/C0D£(lSQi.SEll20I.Ul0,NL,ua,NV,jTTCST,MDU.N*SCURt  JPUNCM 
l«MH,j«Vt.l3iG.JSPK, lOPI 10) ,lSavEl20CI tMATLI2Ui 
COmHon  /ebb/  NSUBi2U)*ll.XAP42U.7 J« 1L9««(30>7 I . J La Ab I 20 • 7 ) • IL|AT I 2U 
I  •?  I.  ILf  *:  (20.  ISO >«lTin(ll21,]SPLT< 10,20.2.9 )«lLAVi20<a  I 

2,ieH5l |S0) 

CUdHON/HCE/KET 1200.91 .J| A, KS A VE( ISO) ,N«nei 100,21 .UNA AI20. 91 , ISPk 
1E1  i  Id 

OlHENSTCM  OE I  20 • I  SOI, IT  1  I  ISO  I . 1T2 I  ISO  I .CH I  1 20 1 .PCX I  1201 

SU*NIU 

K2*aH  TEST 
K3*aM 

IFt JAVE'ST. I  I  K3*aHS 
Kla«H  kHOLE 
lFiN0.iQ.2i  Ki*aH  half 
PAOZ-aXLlSTEN 
Nao2*a'<CRS  ON 
IFIJSPAl  98.99.98 

98  XaOZ**»'SPLAKC 
N*OZ*aHHS  ON 

99  PRINT  91  ,)4L,9W02,N.-.02,JAVt,«i,«2,K3 
70T*0. 

RAX*n«SCOR 
axX*N(}*JA  vE 

IF  I JSPA.NL.O I  aAA*N«*jSP«*|JAVe/NLi 

TX«*l4.*bXX*RiiX 

T0T*0.0 

DO  a  1*1  .1  12 

IF  (noO< 1 ,71.10.0}  SO  TO  a 
TOT*TOT*ITEd( I ) 
a  continjE 

T*NA5C0«*ia. 

IFUSP^.NE.O)  T*T*jSPA 
NO*NXO*OAVE 
IF  IJSPX 'NC.G >  NOaNXQ 
OF  *1(0- I 
DO  7  1*1, NO 
7  IT2I|I*0 

00  a  j*i.NL 

IB-KSU"! ILXO.NO.-J.HOLI 
CHI |J)*0.0 

I l*KSUPI ILXQ.NO.'J.NOLI 
Eb I T* I  I  I / I NO*Y 1 
DO  a  1*1  .NO 

1T2I I  I* IT2I I )*iLXQIj,  I  I 
IC*KSUH| IlXO.NL I  I .NOL I 
OEIJ.|l>ILXQ(j,n-(lC*lB/T0TI 

CM||J|*CH|(JI*(I(1LXUIJ,1 I.EI**2)/E i«(|(lLXQ(J,ll--CI**2l/IV-E)) 

a  PCH| ijibsgnf iCHi (j| ,-or I 

Print  zs,  (code i  i  > .  iors(  i  i  ,  i«i ,jave i 

DO  13  1*1, NL 

QXX*KS09( ILXC.NO.'I .noli 
NXA*|1«X>2*4XX)/TXX 
IF  IJTTEST.6T.DI  RXX*0XX/TXX 
NX (*BX« • 1 OC 
K*NSUB(  I  I 

IFIN0.LE.2I  GO  TO  37 

PRINT  39,NSUB(  1  I  .(NAMEIPC.Ll  ,L*I  ,2  1  ,RX  X  ,5CL  (  I  I  ,CMI  U  I  ,PCH1  (  J  I  , 

I  ULXOI  I  .  Jl  .J*l  ,9  I  ,  lOE  I  I  ,  Jl  ,J*|  .9  I 
39  FOHHXT  I  l9.2Aa.3FS. I .RS.2X,9|9,3x .  9ra.l) 

CO  TO  3333 

37  PRINT  38  ,N5UB  (II,(i.AHCIK,LI,L*|,2I.RXX,SCLIII,CHIMI,PCH||||, 

I  I IlXOI I .J>  .  J*|  ,21  ,  lOLI I ,JI ,J*1 .21 
3a  FORHAT  I  I  9 .2A4.3FS. I  .RS,2x .219, IOX .2Fa. I  I 

3333  continue 

IFINO.lE.NI  go  to  13 
00  813  L*S.N0.9 
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6*a 

7Ua 

71a 

813 

72a 

90 

73a 

.  79a 

33J9 

7ha 

76a 

333/ 

77a 

13 

706 

7*a 

«0a 

8la 

B2a 

19 

83a 

89a 

3338 

BSa 

86a 

87a 

886 

89a 

90a 

16 

9|a 

92a 

93a 

99a  • 

17 

9Sa 

96a 

97a 

98a 

99a 

lOUa 

lOla 

102a 

|8 

103a 

109a 

lOBa 

106a 

19 

107a 

108a 

109. 

1  lOa 

23 

Ilia 

1  |2a 

29 

1  13a 

1  |9a 

C 

1  ISa 

2S 

1  16a 

91 

l|7a 

26 

118a 

27 

1  |9a 

28 

120. 

29 

I2la 

122a 

123a 

30 

129a 

31 

12Ba 

32 

126a 

33 

127a 

39 

128a 

3S 

129a 

130a 

36 

I3la 

la 

2a 

3a 

9a 

5a 

6a 

7a 

8a 

1 

9a 

2 

lOa 

3 

1  la 

9 

17» 

5 

|3a 

6 

19a 

7 

I5a 

|6a 

iriK.G1.NUI  GO  10  3)3<« 

fHINI  •tO.IILIUlItJI  •  JaL  .K  I  ,  (Oe  (  I  •  Ji  .  J-L  .K  ) 
rOXHAI  I3bl  I  I 

bO  TO  t3 

KSL*  I 

rut NT  333/. I ILINI 1 .JI • J*L .K i . I OC I  1 1 J I .JaL.KI 
FONNAT  I  3ltX.2I<«  .  I0«  t2F*.  I  I 
CONTtNcE 
DO  M  jal.NU 
IT| |JI*0 
00  !>•  1*1. NL 
ITI  I  JIaUxUI  I  ,JI«1T1  (  Ji 
CONT INuE 

rOINT  3338. I ITI I J> .Jal .NOI 
FONHAT  <3aAt<l|<*i 

nq-nxo 

FNINT  29 

00  1«  laUNL 

IT  1 1  I laKSUNI ILXAF.naSCOR  .NDLl 
1T2I  t  l>KSuN(  lLX*A.r,ASCOR.-|  .NOLI 
FRINT  30.  NSuaCI i , I ILXXPI t .Jl tjal .NA I t IT  I ( I  I . I 1LX«*( 1 t J) t Jal ,NA I  t 
IT2III 

00  17  J-I.NA 

|T| ( JIaKSUnI UXAP.NL.J.NOLI 
1T2(  JlaKSyfll  IL(*A  .r.L  .  J  .NOL  I 
llaKSUmiTI  .NASCON.l  ,1  I 
I2aKSu:4l  IT2.NASC0R,  1  ,1  I 

FRINT  31.  (IT  I IJ) . ja| .NAI , I  I ,4 |T2IJ| , ja| ,nA I . 12 
FRINt  27 
00  18  |a|,NL 

IT  I  I  I laKSunI ILxAB.NASCOR fl  ,NDL I 
IT2I I iaKSUNI ILXAT.KASCOR.-I ,N0L) 

FRINt  3a.NSuB4ll,(|LXAB(|,J|,jat,NA|ilTtlII.4|LXAT(l«J)tJpl,NA>.I 
1T2(  I  I 

00  19  jal.NA 

IT  I IJiaKSUFI ILX*e.M..J.NOLi 
IT24j)aKSUHIILXAT.NL.J.N0L> 

I laKSUFI  I T1 .NAScOK , I  ,  :  > 
l2-KSu''(  It2.NASC0H.1  .i  I 

FRINT  31.  1 ITI 1 JI ,jal ,NA) ,11 .1 |T2IJi ,ja| ,NA> ,12 
FHINT  IS 
00  29  ta|,7 

FRINT  36,  I ITCMI JI ,js| ,1 12,71 

return 

Format  i ig( ioi2x ,R9 . ina,  in  i/i  i 

format  4 IMI . 107 , 'ScORtS  FOR  • , 1 2 , I  7 , 2«6 , I  X . I  3 , 3 AA I 
format  4 10X,26HOO*RTERS  OBSER VEO'E XFECTEO I 
format  423X,I7HATTR|BUTE  BIAS  •39X  ,  1 6MATTR I  BUTE  TOTAL  I 

format  ll9,2SrS.0l 

format  I33X ,39HIRR0RS  for  LISTENERS  BT  aT TR I bUTES/23X , I 7M AT TR 1  BUT E 
I  FHESEnT,39X, I6MATTRIB0TC  ABSENT/ I  X ,9M ( L a ) , 2  I 9X , 9 7HV0 I C  NASl  SUS 
2T  SIbL  6RAV  COMP  EXFL  TOTAL, 1711 
format  <2H  I,I2,2HI  ,24016.9X11 
format  46h  total  ,2(016  .NX  I  I 

Format  4 iho,37x .26herrors  for  quarters  by  itemsi 
FORMAT  47HOITEM  a , 37 , 1 9 4  | H 4 , 1 3 , I H 1 , | x I  I 
format  4«X,I9I6I 

format  4 InO,39X ,20HERR0RS  FOR  EACH  I  TEN/ 1  OX , 1  OH I TEMS  1 -28 . | OX , 1 > N I 
items  2<f“56  ,  I  ox  ,  IlMl  TEMS  &7-G9,10X,12mITEMS  80-112) 

FORMAT  IlH  ,SX,9|9|9,SXI  I 
END 


FUNCTION  KSUM  I KKK , NN , NRC , NO | 

OIhENSION  KKKINO.I I 

KSUMaO 

KalABSINRCI 

NaiABSINNI 

|al 

IF  INN)  1,5,2 
la2 

IF  4NNCI  6,5,3 
00  9  JB I ,n 

KSuMaKSUM.KKK I J ,K I •• I 
RL  turn 
00  7  ja|,N 

KSuMaKSUM.KKK (( ,J)*a| 

return 
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i* 

2* 

<«• 

b. 

«• 

7» 

a* 

9* 

10* 

I  i* 

12* 

13> 

I*** 

lb* 

ia« 

!»• 

IS* 

I?. 

20* 

21* 

22. 

23*- 

2*l* 

2b* 

26* 

27* 

2S* 

29* 

30* 

3i* 

32* 

33* 

39*  *  J 

3S* 

36* 

37* 

38* 

39*  92 

90* 

9i* 

92* 

93* 

99* 

9S* 

96* 

97* 

98*  93 

99* 

bU* 

SI* 

b2* 

b3* 

b9* 

bb* 

b6* 

S7* 

b8* 

b9* 

60* 

6  I  * 

62*  I 
63* 

69* 

6b* 

66* 

67* 

68* 

69* 

70* 

71* 

72*  2 

73* 

79. 

7b* 


bU^hCU^  I  i»i.  F  1 1«  I  I 
iNlLbE*'  COOL 

Cunnur</ALL/CCUt(lbC),SLL(20I.Na|NL|N6  <NV , j7TLST (NOL (NASCOK ,3PUNCb 
I tNO.JAvE . IBIG.JbPK .10P(ICI.Ib*VEI2nOltN«TE(20t 
COHMOU  /HF/  I  aHlE  (  I  3  >  ,  ITST  ,r4A*ME  (20  I  ,L  I  1ST  (2Ul  •  JPJlK 
COMHOh  /SCORE/  PAP(7I.SAP|7),PAAl7ltS*6(7),PAbl7I.SABI7),PAT|7lib6 
IT(7I.P>(ei,S<IP)|PTOT,STCT,KATE<10),SCRATc(IUI tbPOl  10.  2.9  |  .SP02 ( 
210.2.9) 

IF ILABLE I  131 .L J.O I  LAHLE(t31«68 
IF (LABLE I  12 > .E^.O I  LAaLt(|2)*6H 
IF( JAVE.NE. I  I  LABLEI 12I*6HHUlT| 

PRINT  3. ILABLE  <31 .3*2.9  1 . ICOOE I  I  1 • I > I • NO . 9  I 
HtO,.|*AND1  77  7  70  .LArtLF(  11)1 
HL0*2*A'<0I7777B>LSh|FT(LABLCI  I  I  I  .-12)  1 

»1tO»3*ANO(77776.LSMlFT(LABLE(  I  I  )  .-29)  ) 

PRINT  9, IL ABLE! 3) . 3*7 . 1 0 )  ,HE063 . ME0A2 . "EO A  I .LABLEI 12 ) 

PRINT  b 

print  6.  PAP|l|.SAP(l).PAA|l|.SAA|||,PAail| .SAB| I  I .PAT  I  I  I .SAT  I  I  I 
PRINT  7.  PAPl2l>SAPI2>.PAA(2I.SAAl2l,PABl2ltSABI2I.PATI2I.SATl2) 
print  8*  PAPI3)  •SAP|3I.PAAI3I.SA*<3i.PASl3l .SAB  131 .P A T I  3 ) . SAT  I  3 ) 
print  9|  PAP(<.).SAP(9I.PAAI9ltSAAl9|,PA9l9)>bABl9).PAT<9|.SATl9l 
print  10.  PAPtBi .SAP (51 .PAAIBI.SAAISI.PABIBI.SABISI.PATIBI.SaTIB) 
PRINT  II.  PaP(6I.SaPI6I.PaaI6>.SAAI6I.PABImI.Sa8I6I.PaTI6I.SaT|6I 
PRINT  I  3. 1 (SP0I9 .j, I  I ,SP02I9, J. I  I • I - 1 . 9  I . 3* I  . 2 ) 

print  12.  PAAI7),SAA(7I .PAP  I  7 ) .SAP  I  7  I . PaB ( 7 >  .S AB I  7 ) .PAT ( 7 ) .SAT ( / ) 

PRINT  19 

INLAbni, 

ISPA*| 

HAUZkuFNUN  of 
N802*6h  LISTe 
3*0Z*6>  NERS 
3N12«6-'9ER 
IFIJSPK)  91.92,91 
N*0Z»6*>  speak 
3AaZ*6HERS 
3NIZ*6-ER 
INLX* jSPK 
ISPA*NL 

continue 

print  |9.  INLX.PVI 31  .SVI3) 

PRINT  ZO.lSPx.PVlT) .SV(7) 

Nn*|6*EQ*NASC0H*JAvE 
print  7l .NN.Pv I  9) .Sviei 

P.<1NT  12 ,  PV(9I.SVI9) 

JNIZ*3P3XR*I 
IF ( 3PU\CH.CQ.O )  3N1Z*I 
DO  93  l*3N|Z.t2 
NAAMe I  I • "AH 

print  |7.INAAHF(I).|*l.|2),Pvl2l|SV(2l 

PRINT  |b.  PVI6I.SVI6I 

print  iB.  PV(|).SV||) 

print  I  a .n*OZ .3A0Z .PV lb ) .SV (S I 

IF  l3PUNCH.NE.0l  60  TO  1 

print  2b 

print  29 
print  23.  PTOT 
PRINT  29 
PRINT  27,  3T0T 

Print  29 

PRINT  7S 
HL ) URN 

print  29 

PRINT  30,  RATEI I ) .SERATEI I  1 
PRINT  3l.  RATEI2I  .berate  12)  ,PToT 
print  33,  rate (3) .SENATE  I  31 
PRINT  32,  RATEI9) ,SERATEI9I ,ST0T 
print  39,  RATE  lb) .SERATEIb) 

IF  INN.GT.B)  bO  TO  2 

Print  26 
Print  99 
return 

PRINT  28,  RATLI6) ,SERATEI6) 

Mf  0* I ■ AH 
Ht0~2*6)i 

IF  l3Avt..LT.2l  3''  0Z*»H 


7A* 

77* 

78* 

79a 

'  80# 

893 

81* 

92a 

99 

83a 

89a 

C 

8Sa 

3 

8Aa 

87a 

9 

88a 

89* 

5 

9C* 

91* 

92* 

93* 

-  * 

9<Ia 

7 

95, 

8 

94* 

9 

97a 

10 

98* 

1  1 

99*. 

12 

100* 

13 

101* 

102* 

19 

103* 

IS 

109* 

105* 

14 

104* 

107* 

17 

108* 

18 

109* 

no* 

|9 

111* 

20 

112* 

21 

113* 

22 

1  19* 

23 

1  15* 

29 

1  1  4* 

2S 

117* 

24 

1  |8* 

27 

1  19* 

28 

I2C* 

121* 

29 

122* 

123* 

30 

129* 

31 

125* 

124* 

32 

127* 

128* 

33 

129* 

39 

130* 

I»  (  J«V(.«LT.2) 

IF|J«v£.LT.2)  bO  ro  6932 

107 

ntOt<2>A>'Cu  9Y 
CONTIt.uC 

PKINT  fi.KtOif.  I  ,"EO  2,N>.02,J(l0i 

FONHaT  IbX,  •  (dUALITT  RATINGS  NOT  FOR  SCIENTIFIC  USE  >  •  •  1 9X  ,  •(  A  a  I 
return 

format  IlHl  ,i«X,32HOIAGNOSTIC  RHYNE  TfST  SCORES  F OK , JX , 3 AA • 2  I  X  ,  1 U I H 
MtlXI  ) 

F0RHaT{5X,22hexPER|HENTAL  CO.mO  I  T  I  ON  ,  2X  ,  H  A  A  .  AX  .  •  0  A  TE  TESTEo  •,K2, 
|•/•R2t•/•.R2,2X^•l.  1ST  NO.y.AA/I 

format  I  Sx  i9hatTR  muTE  t9x  •SHMEAN  F  OR  .  3  X  •  HHS  •  E  •  t  2  X  i  8HME  AN  F0R,<4x,nM 
IS«E> •2> iShhEaN  FOR.YX iYHS.E* i2x  tHNMc^N  F0R|9X,<«MS.C«/23X,9HATTRItU 
2Tt ibX  tYMATTR IbOTE .9X ,9hATTR leUTE i9»,9HATTR|BUT£/,23».7MPRtSENT,I0X 
3tAHA6SENT.l2x,5H0IFF./t 
format  ISX,7HV0ICI'.Ginx,RIFA«lt3X«FA«2i3X|/i 
format  (SXaSHMASALlTYtlOX.RlFA.I t3X.FA.2t3Xl/> 
format  lSX,10HSUSTLIITt0N,8X,9(FA,l ,3x,FA«2.3x)/) 
format  l.Sx  .  IOhSIBILAT  I0N.8X  ,9  (fa.  li3XtFA.2(3xl/l 
format  I5X^9MGRAVE^E5S.9X,1^^FA,1 ,3X,rA.2t3Xl/> 
format  CSx. I 1MC0MPACTRESS,7X,9«FA.1 •3X«FA.2»3X)I 
format  ISx , I 3HEXPER IHENTAl  ,S X  ,9  I  F A .  |  ,  3 X t F A  .2  •  3 X  11 

format  I6X.ISHBACK  VS.  FRONT  .2X , 9  I F A • I • 3X ,F A . 2 1 33  I /8X • 1  SMB AC A  VS* 
I  MIDDLE i2X|9|FA. I ,3X ,FA.2 ,3X  )  I 

format  I//S7x,|3HV0AEL  context. BXi9HhCAN.8Xi9HS.E.I 
format  ISx. 'Remaras; I (Experimental  itEps  are  not*  .20x,9M(omi ,  i  ix. 
IFA.I  .AX. Fa. 21 

format  I13X.*2IALL  S.C.*tlM*.*S  BASED  ON  MEANS  OF  • . 2 A A . SX . 9H I  AH )  , 
I 1 1  IX. FA. 1 .AX .FA. 2./ I 

format  ISx . IChSPEAKbRISI .2X.|2A3«8X,9HI00),I1X.FA.1.AX.Fa.2) 
format  I  t 7X  .  • INCLuCEC  in  any  summary  SCORES. • . I 3X .9h I AAl . I  1 X.Fa.  1  • 
I6X  .Fa.2 I 

format  ISx, 'number  OF  L I STENERS * • I R • 33 X , 9 H I  EE ) • 1  I  X , F A . I . A X , F a . 2  I 

format  ISx, •number  of  speakers  * . |9 ,33X .9HI iMl , I  I  X ,F a. 1 , ax ,Fa.2 > 

format  ISx, 'CRT  aOROS  presented* f I9,28x ,9H(EhI . I IX.FA. I .6x,Fa.2I 

format  IA1X,9hIATI,IIX,F6.|,aX,FA.2I 

format  ISSX , |Hx .ax , ISHTOTaL  DRT  score ,9X ,T a . I ,aX , IHX I 

format  I SSX , I hX , 37 X , 1 HX I 

format  'SSX.37mXXXXXXXXXXXXXXXXXXXXXXXXXXxXXXAXXXXXXXXI 
format  ISSX,37hXXXXXXXXXXXXXXXXXXXXXXXXXX>XXXXXXXXXX| 

Format  issx i ihx .ax . irmstanoard  error .sx »fa.2 , ax .  imx  i 
format  ISa . I8HK0U0m  vs  smooth  ,F9 .2 >3X .F 5.2 i20x ,3;hXXXXaxXXXXXxA 
IXXXXXXXXXXXXXXXXXxxXXXXX) 

format  (Sx,3lMUUALtTr  ratings  mean  S.E. , |9X.39MXXXXXxXXXXXxX 

IXXXXXXlXXXXXXXIXXAXXXXXX  I 

format  ISx.IBHSOFT  vs  loud  (F9.2 i3XFS .2 ,20X , Iha  •3SX  ,  Ihx  I 

format  (Si ,  I phtreble  vs  Bass  ,F9 .2 ,3xfs.2 ,2nx , ihx ,9x  ,  ishtot al  o 

IRT  SC0RE.9X.FA.I .Ax.lHXl 

format  I  Sx  ,  IBMUNPLSNT  vS  PlSnT  . F 9 . 2 . 3 X FS . 2 , 20X , | hX , 9 X , I mhS T AND aR 
ID  ERROR  .Sx .Fa. 2 , AX , IHX I  . 

format  ISx  ,  IBHUNCLCaR  vs  clear  ,F9,2 ,3xrs.2 ,20X , ihx  ,3SX  ,  IHX I 
format  ISX.IBHONNAT.  vs  natural  •F9.2.3XFb.2,2UA.lMX,3SX,|HX| 

END 


1 

2 
3 

9 

5 

A 

7 

• 

9 

10 

1 1 
13 
|3 

IR 

IS 

I* 

I  7 
|M 
IV 
20 
21 


function  PRBFIOA.OB.FRI 

PRBFal .0 

IF  lOA  .LL.  O.')  return 
IF  (OB  .LE .  0.01  RF  turn 
IF  (FR  .L£.  0.01  return 
IF  (FR  .LE.  1.0)  GO  TO  S 

Aao  A 

HaCB 

F-FR 

GO  To  10 
S  A«oB 
B*nA 

F  •  1 .0/)  R 

10  AAa2.0/ I9.C*A ) 

))Ba2. 0/19.0*0) 

2aABSI|II.O*PI<l*F**. 333333*1. D*AAI/SuHT<P  It* F**.6AAA67.AAII 

IF  lO.Ll.R.CI  /•/*(>.C*.0P.2**9/|i.*t| 

PHHFa, S/lt.C./*(.lvA8S9«2*l. I ISI99. /Al, 000399.2*. U|VS27)I))*.9 

I )  I Fn . i T  .  I , C  I  mF ■ I . O'PRHF 

RE  1  URN 

LNU 


I* 

2* 

)• 

••• 

&• 

*• 

7, 

»• 

«• 

10* 

II* 

12* 

|3* 

M* 

lb* 

l«* 

17. 

!•* 

20* 

21* 

22* 

23* 

2‘»* 

2&* 

2** 

27* 

2«* 

27* 

JO* 

Jl* 

J2* 

JJ* 

J7* 

JS* 

3** 

37* 

3t* 

37* 

>•0* 

*1* 

72* 

73* 

77* 

7S* 

7** 

77* 

7«* 

77» 

SO* 

SI* 

S2* 

S3* 

S7« 

ss* 

s** 

S7* 

S8* 

S7* 

«0* 

*1* 

*2* 

*3* 

67* 

6S* 

66* 

67* 

66* 

67* 

70* 

71* 

72* 

73* 

77* 

7S« 

76* 

77* 

76* 

77* 


SUbROO’I'-t  FihtS 

CUDE  108 

CUnbUI</*>LL/CUlitilbSl,SLLI2CI.NS,NL«N«,NV,jTT[.ST  (MbL  ,66SC0n  ,  jPuhCh 
I f UH, J«vE , IC lb t JSPk . IOPI 101 . ISAVt I2CC I tN«TE I2U I 
cunnoti  /•>;/  L*eLE  I  |  3  I  1 1 7ST  .maAhE  1 2r  I  .L  I  1ST  1 20  I  .  JPbl* 

COPMftN  /SCOPE/  P*P I  7  I .SAP  17  I .P6AI7I.SAAI7I ,P*bl 7  I .S*llt7 I .P«T ( 7  I .S* 
IT  17  I ,P«  ««•  I ,SVI7 I .Pint .STOT.MaTCIIO) .senate  I ICI  .SPUtlO.  2.7)  .SP02 I 
210.2. 7( 

OINLNSICIi  0110.2.71 

00  I  1*1.10 

00  I  J*l.2 

DO  I  K*l.3 

0( I . J.K labH 

01  I  .  I  .  I  >*6HrRlcT| 

01 1 1 1 .2I*6H07AL 

011.2.1 •■AHNOM  N| 

Oil  t2.2l*6MCT|or.A 
01  I  (2.3I*6HE 
012.  I  .  I  l■6HCRAVe 
012.2.1  •■AHACUTE 
013.1  .1  I>6HV0ICE0 
013.2.1  l*6HUNV0IC 
013.2. 2IB6ME0 

017.1.1  l■*MVOICEO 

0(7.2. 1  l*6HUN«0IC 
0(7.2.2)*67eo 
OIS.I  .  I  *-6HV0ICED 
0IS.2.  I  I■6HUNV0IC  ' 

0(S.2.2 labHEO 
016.1. |I■6M  STO 
016.1  .2)*6HPPE0 
0(6.2. ll-AH  UNS 
0I6.2.2>*ahT0PPE(> 

01 7  .  I  .  I  l*6HV0ICi0 
0(7.2. 1 >*6HUhV0iC 
0(7.2.21*6^10 
0I6.|||>*6H  SUS 
0(6.1. 2i*6MTA(NE0 
bl6.2.1l*6H  INT 
nik.2.2l*6HERRUPT 
oie.2.3iBoHeo 
0(7. 1  .2>*6HB/n 
0(7.2.7>*6HB/F 
NPZ*N0* I6«NASC0N*JAVC 
PC0bt«A'»D(7  77  7B.LALLC  (  I  I  I  I 

*'10«2*AS0(7  777B.ESh|fT  (LABuEI  I  I  I  .- 12  I  I  • 

H£063*»70(  777  7B  .LSh |FT (t ABLE  I  I  I  I .-27  I  I 

print  S.  (LABLE I  I  )  .  t-2,7) . ILABEEI I  1.1*7,7  1 .PE063  .NC0.2  .NEOa I 
PRINT  6 

PRINT  7.  P API  I  I  .SAP  I  I  I .PAAI I  I .SAAI I  I .PABI I  I .SABI  I  I .PATH  I  .S ATI  I  I 
AX*I 

IF  I lOPIKXI .ce.bl  PRINT  7.  t O I Kl . I . J I . J* I . 3  I . I SPO I K A . 1 . I | .SP02 I K A . 
11.11.1*1.71 

IF  I lOPIKA I .EQ.OI  print  7.  I  0  I  A A .2 . J I . J* I . 3  I . I SPO I « A .2 . I  I .SP02 I  A A • 
12.11.1*1.7) 

print  a.  PAP(2I •SAPI2i .PAAC2I .SAAI2I .PAB(2) .SABI2I .PAT  121 .SATI?) 
KA*KA* I 

IF  I IOPIKaI.CQ.OI  PRINT  7.  1 0 UX . I . J I . J- 1 . 3  I . < SPOlK A . I . 1 1 .SP02 I « A . 

11.11.1*1.7) 

IF  I  lOPIKAI.eO.OI  PRINT  7.  lOUA.J.J)  .J*|  .31  .  (SPOUa.2.  I  )  .SP02IK)|  . 

12.1) . 1*1, 7) 

PK|(iT  7,  |■API3),SA>  13)  .PAA(  3)  .S*AI  3  )  .PAti  (3  )  .SAB  13)  .PAT  13  )  ,S*T  13) 

AA*AA* I 

IF  l|OPI).A).CU.Cl  PRINT  7.  1 0  I K  A  .  I  .  J  I  .  J- I  .  3  >  .  <  SPO  I K  A  .  I  .  I  I  .SP02  I  A  A  . 
11.11.1*1.7) 

IF  llOPIAAI.E6.OI  PRINT  7,  I  0  I K A .2 . J I . J* I . 3  I . I SPO I  A A .2 . I  I . SP02 I F A . 
12.11.1*1,7) 

PRINT  10.  PAP47l.SAPI7).PA*(7l.SAA(R|.PAS(7l.SAB(7).PATl7).SAT(7| 
KK  aK  X ♦ 1 

IF  I  lOPt AA )  .Eb.n )  print  7.  lOlAA  .1  . J)  .J*l  .3)  .ISPOIAA. I  . I  ) .SP02(AA. 
11.11.1*1.71 

IF  I  IbP  I  A  A  I  .E(..(<l  FRINT  7,  lOIAA  .2  .  J)  .  J*1  .3)  .(SPOl  AA.2.  I  I  .SP02I  Aa  . 

12.1 )  .1*1 .7) 

PNIF-T  II.  F'API  b)  .SAPISI  .PaaIS)  .SAAISI  .PARIS)  .SAB  I S I  .PaT  I  S  I  .  S  A  T  I  b  I 
Ra*aa»i 

IF  I  tllPlAi  •  .Eb.l'l  PRINT  N,  (riAA  .1  .J)  .j*l  ,31  .ISPOIAA  .1  .1  |,SPb2lAA  . 

11.11.1*1.7, 

IF  I IOP'Aa) .Eb.OI  PP|NT  7,  lOlKA .2. Jl • j*| .31 .ISPUIAA .2. 1 1 .SP02I Aa. 
12.11.1*1,7) 


•0*  K<aK|*|  109 

•I*  ir  i lOriKI I •CU.OI  PRINT  IO(K(< I • Jl • J*l t9l •<SP0IKA.|.| I .SPB2ik«. 

■  3«  IF  I  |or<«.«l  .E6<Ci  PRINT  H  .  I C I K  X  •<  .  J I  .  ja  1  ,  3 1  ,  I SPO I R*  .2 1 1 1  .  SPO^  I  a  t  « 

•  Ra  12 1 1 1 • tRI 

•  PRINT  I2t  P*PI«I i&«PI«i tP««U> .SRRI4I tP«bl*l (SRalRI  .PRTI*i .SaTlai 

•«a  R|aR|«| 

•  7a  IF  l|OPI«»I.C(I.OI  PRINT  R  .  1 0  IK I  •  I  •  J I  t  Ja  |  ,  3  I  ,  I SPO  l«»  .  1  . 1  •  .SP02  f  a  «  . 

••a  ll•|li|al,•t| 

•«a  IF  l|OP<Rll.ca.OI  PRINT  R,  lOUl  *2 .21 1  ja  |  ,3  )  ,  ISPOIKI  .2*  1 1  tSP02  laa  , 

RUa  l2»|l,|at.RI 

Ria  KXaKX«| 

R2a  IF  I  lOPI  KX  I  tCO'C'l  PRINT  R,  i  0  <  V I  •  I  •  J I  1  ja  I  ,  3  I  t  •  SPO I K  a  ,  1  .  1 1  .  SP02  •  a  a  , 

R3a  lltll.l-lfRI 

RRa  IF  I lOPIKal (CU.D)  PRINT  R,  I  0 1 K X 1 2 • J t , ja | , 3  I , i SPO I Ka . 2  *  I )  •SP02 I  a  a . 

R&a  12a|l.|a|,R> 

R*a  KXaKXal 

R7a  IF  i lOPiKXI .EU.O)  PRINT  R,  1 0 1 kX • I • J I • ja 1 , 3 1 . I SPO • aa , 1 . Il .SP02 I  a a . 

RBa  .  I  I 1 1  I  ilai .al 

Rpa  IF  ( IOPIKxi.EU.Ol  PRINT  R,  1 0 1 KX .2 . J | . Ja I . 3  I . • S*OI Ra .2 . I  I .SP02 1 Ka . 

lOOa  l2i|l.|altRI 

lola  print  I3a  PAX < 7  I .SAX 1 7  I .PAPI 7 1 .SXP I  7  I .Pa» 1 7 i .SaRI 71 .PXT 1 7 1 .SXT I  7 1 

102a  print  iA 

103a  IFIJPOXR.GT.O)  60  TO  2 

lORa  PRINT  |R 

lOSa'  IR  FORNaT  (//I 

lOXa  60  To  3 

107a  2  print  I A t INAANE I Jl i Ja I . jPUIR > 

IO«a  PRINT  IS.ILIISTIJI  .jal.JPQXRI 

lORa  lA  FORNAT  I SX  •  SPKR I S I  a • , | a .20X4 i 

Iloa  IS  FORNAT  I Sx . * L I S T I S I  a • , 30 A* | 

Ilia  3 

l|2a  NROIaAMLISTEN 

Il3a  NA02aAHERS 

URa  IF| JSPKaEU.Oi  60  TO  31 

llSa  NAOIaAMSPLXKE 

llAa  NA02a4HRS 

l|7a  31  CONTINUE 

l|*a  PRINT  32 

lIRa  PRINT  17,NaO| .Na02.NL (PTOT 

120a  17  FORHaTISX.<NUMBER  OF  • *2 A4 . 1 3 .371 . 1  NX .6X , • TOT AL  CRT  SCOREatFA. | .aa 

I2la  ItIMXI 

122a  PRINT  IO.nPZ.STOT 

123.  Is  FORNaT  ISX.'NUMBER  OF  ROROS  PER  TE S T • , | e . 30X , | Ha ,SX . • ST at,u ARO  Eh«0 
l2Ra  |Ra«.FA.2.SX.|HXI 

l2Sa  PRINT  32 

72Aa  32  FORNAT  > A7X . • XX XXXX XXXXXXXXXXXXXX AXXXXX X X X X XXX • I 
127a  Return 

I2*a  c 
l2Ra  C 

•30a  R  FORNAT  <SX . 2A6 . AS .R I F A . I .SX  .F A .2 . SX  I  | 

‘^•»  b  FORNAT  I IHI .RX.'Cu'^TRACTOR;  • .3X4 ,SX ,• TEST  CONDITION:  aSAA.SX, 

132a  I’OATE  TEStEO  * tRT • • / • •R2 . • / • ,R2 | 

•**a  A  FORNAT  1 2 1 X ,4hPRE SN T . 7X ,RhS .E . tSX , AHaOSE NT , 7X .RhS .E . .S X ,RHB I  AS ,R X . 

l3Ra  IRHS.E. .SX.SHTOTaL.bX.RHS.E. I 

•3Sa  7  FORNAT  • /R a , 7hv 0  I C 1 N6 .RXR I F A . 1 . SX ,F A . 2 , SX  I  > 

l3Aa  •  FORNAT  < /R X • SnN XSAL I TT .tX , R I F A . I • SX ,F A . 2  . SX  1  I 

137*  *  FORNAT  l/RX.iOHSUSTENTlON.AX.RlFA.I ,SX,FA.2t5XI  I 

I3*a  10  FORNAT  I /RX ■ I  OPS  I • I U AT  I ON . AX , R I F A . I , SX . F A . 2  .SX >  I 

•**•  II  FORNAT  I /RX .RM6NaXLNESS.7a ,RIFA. I  (SX ,FA.2 ,SX I  I 

iROa  12  FoRNAT  < /RX . | | hCOHP AC TnESS .SX . R I F A . I ,SX .F A . 2 . SX I  I 

IRla  13  FORNAT  < /RX . | SHE XPER I NENT AL • . 3X . R I F A . I , SX , F A . 2  ,SX M 

lR2a  end 


la 

FUNCTION  SANFIT.OFI 

2a 

SuNF  asH 

3a 

IFIDFI  I. 2. 3 

Ra 

1 

DFaOFa-l 

Sa 

IFIPRBF 1  OF . I00?« .T/OF 1 .LT .  .OSl  SANFaAMpR.OS 

Aa 

IFIPRRf I0F,|C0C«<T/0FI.LT.  .a||  S6NFaAMP<.0| 

7a 

IF |PR8» lOF , IOC' . ,T/OF 1 .LT . .001 >  SCNF a AMP< .00 1 

•  a 

return 

R* 

2 

S6t.F**Hnf  ■  0 

|0a 

Return 

1  la 

3 

IF IPSuF 1 1 .O.OF . T a.2l .LT.  .rsi  SANFaAHr<.0S 

|2a 

IF  IPPSF  I  1  .C  tTF  ,  T  aay  1  .1,7  .  .oil  S6NFaA„p<,0| 

|3a 

IFIPRlil  ll.n.ni  •taa7l.ET..0ril  SfcNF  aAHPx.CCI 

|Ra 

return 

I* 

FUNCTIf.  HR9LlilA.0b.FI 

2* 

Pat  NBF  CtlA.US.F  ) 

3. 

IF  IP*.IuIA2.a1  .Al 

9* 

Al 

PNUL* A" 

S* 

REIURN 

A* 

A2 

IFIP-.rblA9.A3. *3 

7  * 

*3 

PR|»L*Ar»’<,  10 

•  * 

return 

9* 

A9 

IF  IP-. 01 IaA.AS.AS 

10* 

AS 

PRBL*9-P< .05. 

■ 

1  1* 

return 

12* 

AA 

IFIP-.rOi l6a,A7iA7 

13* 

A7 

PRdL*A-P<.01 

|9* 

FtETURN 

IS* 

AS 

PRBL*AhP<.OOI 

19* 

return 

17* 

ENU 

110 


2»  C 
3*  C 
C 

s«  c 

*• 

7* 

•  • 

«• 

lO. 

1 1* 

12* 

|3. 

!**•  I 
lS«  2 
>*•  3 

17. 

|8«  <1 
!»• 

20* 

2t*  & 

22* 

23* 

2‘«* 

25* 

2** 

27*  A 

28« 

27» 

3U*  7 

31* 

32* 

33« 

3‘*» 

3S«  • 

3*« 

37* 

3#* 

37* 

AO*  9 
9I« 

-2.  10 

«3« 

•4S*  1 3 

«*• 

H7» 

AS* 

20 

SO*  IS 
SI* 

S2* 

^  3*  I* 

St* 

ss* 

s**  c 

S7*  I  I 
S«*  12 

tv* 

*0* 


function  tSUB  |3I 

TrtiS  ROUTlNi:  keeps  «  LIST  OF  SUaJECT  NuHBtPS  USED  FUR  A  LIST 

and  alluxs  for  oiffcrent  Sequences  of  subjects,  it  returns 

AN  ARBITRARt  NUNBER  uhIcm  IS  COI.SISTANT  for  AliY  ONE  SUBJECT 
IT  also  checks  for  bad  KETFUNCHInO  or  too  nant  subjects 
INTESE'i  CODE 

C0nn0N/ALL/C00E« ISOi ,SLL(20I .Mo.NL.Na.NV.JTTEST.HDL.NASCOR.JfunCh 
I .nr, javE . IBIG . JSPK . lOFI IG I . ISAVE I 2C3| .NATe(20I 
COnHON/HCE/KET 1200. V  >  t Jl A .KSAVE I  I  SO ) .NAME  I  100 .2 1 • I ANKA < 20.9 J . IS^K 
lETI lOi 

dimension  InAHE I2CI . ISFARI 1001 

IF  IJ.NE.2HAA)  CO  TO  H 

00  I  1*1.100 

ISFARI I  1*0 

00  3  1*1 .23 

INABeI  I  1*0 

RETURN 

Continue 

IF  IJ.CQ.2HBXI  CO  TO  2 
IF  Ij.NE.2HCX)  CO  TU  7 
READ  II.  KOP.KSUB.NAHI .NAF2.KF0 
IF  IKOP.NE.O)  GC  TO  A 
NAMEIKSUB. I l■NAH| 

NAHEIKSUB.2I*NAH2 
IF  IKFO.NE.O)  RETURN 
CO  TO  S 

ISPAR|rOP)>KSUB 
IF  IKPO.NC.O)  return 
GO  TO  S 

IFIJ,LT.-V9I  CO  TO  13 
IFIJ.LT.O)  GO  TO  |A 
IFI ISPARIJI .NE.OI  JalSPARIJI 
NSuBaNL 
1*0 
I*!*! 

IF  U.gT.NSUPI  CO  TO  10 
IF  I J.EQ. INANE ( I  I  I  CO  TO  9 
IF  ( inane ( I  I .NE .0  I  GO  TO  B 
INAHCI I l-J 
ISuBal 

return 

"rINT  l2,  '.SOJ.J 

ISUB*0 

return 

IREKU*ABS( Jl 
00  19  Kai.JSPK 

IF INATE IK  I .CO. IRENUI  CO  TO  IS 
PRINT  70 

FGRNaTi  »  ineligible  speaker  OOi.*.F  IELO*  I 

ISUB*K 

IRCNu*F 

Return 

ISUB*|xENU 

J*|REHU 

Return 

FJRHaT  <  12 . 12 .7a .2A* .AOX  .  12  i 

FORMAT  I  10X,7|H***.***...  more  TM AN , 1 1 . I  2 , I  X . 1  I MPN£ SERT  S**.I|0.1 

. . .  ) 

LNU 


Ill 


I* 

2* 

>• 

••• 

«• 

7« 

•  • 

«• 

10. 

II* 

|2* 

13*  I 
I*** 

IS* 

I** 

|7*  2 

!•* 

It* 

20* 

21* 

22*  21 
23* 

2‘»«  3 

2S* 

2** 

27* 

2** 

2t* 

30* 

31* 

32* 

33*  I  I 

3** 

35. 

34* 

37*  *1 

3«* 

3t* 

•lO*  *1 
*1* 

*2* 

*3* 

**•  **• 
tS*  S 

*** 

•(7* 

*■* 

*♦* 

SO*  4 

SI* 

S2«  7 

S3* 

S4*  • 

Sb* 

S4* 

S7* 

SB*  9 
Sf*  10 

40* 

41* 

42* 

43*  12 

44* 

4S* 

44* 

47. 

44* 

44*  13 

70* 

71* 


SUBROUTIhL  N«T|N6  II4CI 
iNTCfiEH  coot 

COHHON  /4LL/COOEI  IbCl  tSEL  120  |  .149  t  *<HL  .N«  ,NV  .JTTEST  iMUL  tN^SCOR, 
13PUNC  i.NK.JAVE.IBU.JSPK.IOPI  ID)  •iS4VI200l 
C0MH04  /Score/  PAPI?) .sap  it I ,PaA|7 i ,SAAI7> .PabITI tb«|tl7 I ,P«T it i ,s* 
IT(7) .Pv IB) .SvIB) ,PtOT>STOT.R ate IlD) .SCRATEl )U) .spoil U.  2.*) .SPo2( 
210.2.41 

COHHOM  /HF/  LAbLEl 13) .tTST.NAA«iCI2DI.LIlSTI20l .JPQaH 
01 MENS  I  ON  PRATE  I I0| .ORATE  I | 0.20 >00  I 
INTE6EK  ANAME.AtlST 
NL*NBL 

IF  IINC)  3.S.I 

continue 
00  2  1*1.60 
00  2  U«I.NL 
00  2  K-I.IO 
ORATeIK.J. 11*0.0 
N0AL*O 
UPQXR*0 
DO  2|  1*1.20 
NAAHE 111*0 

LliSTI|)*a 

return 

ANk*NL 

N9XL*NiSXL*| 

laNOXL 

*NOXL*nQXL 

INA*| 

IF  I|NC«LT.-II  1N**-1 
00  4  JJ*1 .NBL 

Read  n  t anahc ..list  .  il. i prate i« )  tx*) .  ti  .lablei 1 1 1 . ilableik  i  .k*2,4 

I  I . ILaBLE ( A  I .K*7 .4) 

FORPAT  IrX.AT.AR.U .7F3.0,Aa.1X.3A6,|X.3AaI 
J-ISUBI  ID 

IFI JSPx.bT.Ol  J*ISuBI-ANAN£  I 
00  4  K*1 ,NR 

ORATE iX iJ. I laORATE lX.U.I I *PR«TC I* • • IN* 

00  4|  JJ*l.jPbXR 

IFINAArEI JJI.CU.ANANE)  60  TO  44 

CONT INjE 

JPOXR*JPO*R*|  ,  * 

NAANEI jP6XRI*ANAHE 

LI ISTIUP9xRI*ALiST 

return 

00  B  K*I.NR 

TEMP2*C«0 

DO  7  Jal.NL 

TENP*0.0 

00  4  1*1 iNDXL 

TENP*oR*TeIX.J, I )•TENP 

orate (X .J. I I*TENP/ANCXL 

TENP2*TENP/AN6XL*TEPP2 

RATEIX l*TEnP2/ANL 

continue 

00  10  X*|.t,R 
TEHP*0<0 
DO  4  J» 1 ,NL 

TtNP*l I0NATCIk.U.1|-RATCIk|I**2I*TENP 
SERATclK)*SORT ITENP/INL'I I )/S0RT|Nl) 

IFI  JAVDbT.  I  )  GO  TO  12 
kASLEI|2l-ALIST 
LABLEI  |3|*ANAISE 
continue 

IF  I JTTEST.nE.C  )  60  TO  13 
RATEI I I*B.-RATEI  I  I 
RATEI2I-6.>R*TLI2I 
R*TE|4I*B.-RATEI4I 
R*TEI4>*<<*>RATCI4) 

continue 

return 

END 


I* 

)• 

Hm 

b* 

6  • 

!• 

«• 

9* 

10* 

It* 

|2* 

13* 

IH* 

IS* 

14*  9 

17* 

18* 

19. 

20*  . 

21* 

22* 

23. 

29. 

25. 

24. 

27. 

28. 

29. 

30* 

31* 

32* 

33*  I 
39* 

35. 

34. 

37. 

38. 

39. 

>•0* 

Ml* 

92. 

93. 

99. 

95. 

94. 

97. 

98. 

99.  10 

50. 

51. 

52. 

53.  2 
59. 

55* 

54* 

57* 

58* 

59* 

40* 

41* 

42* 

43*  3 

49. 

45* 

44*  9 

47* 

48* 

49.  5 

70* 

7t* 

72* 

73* 

79. 

75*  4 

74* 

77*  7 

78* 

7  *  •  *9 

tiU* 

I*  i  • 

62* 

83* 

89* 


SupROuf I't  5TD*C  , . « 

IMLtt-  COliE 

Cunnori/ ALL /CODE  ll5Cl,5ELl23|,NXS,)«L,NA,NV,jnESl  .NOL  ,N  ASC  UM  ,  JFu><( 
li'>9iJA<Eil^l(.  .j5P.,lbPIILI,I5AvEI2;>3l(':ATLl2ul 
CUKMOr,  /ScOPl/  PAPI7).SAI'(7),PAAl7i|SAAI7i,PAai7l>SAal7),PAT(7i.;,. 
IT(7>,P.l8l,5vl6l.PT0T.STOT.KATEII0).SERATEIiO),5PUIlUi  2.9),SPC2I 
2 lU ,2 ,9  I 

Conner.  /ERH/  f4SUBI7U)  .lLAAP(20.7i.ILX4AI20i7),{LAAB«2Ut7l.lLlATI^0 
1  .7  )  .  IL>'.  (20.  II  0>  .  ITLPI  I  121  .  ISPLT  I10,20.2.9I.1I-XVI20.8I 
CALL  P<T|n4  (0) 

T'C’.O 

If  IjTTtST.NE.CI  1*100.00 

NQ.NXS*  JAVE 

AABNQ«f«L 

if  IJSPA  *01.0)  bO  TO  8 
U>iB5.NL.|riL'*l  I 
DO  1  1*1. l^A 

Sx*KSU">  >  iLXAP  ,.-,L  .  1  ,NOL  I 
SX2*X5bP I ILXAP .-NL , 1 .MOL ) 

SAP t I  1.5041 I425..(SX2>SA*.7/NLI/U'resi/NQ 

PAPIll*l(AA.8,-(2.SA))/IAA.6.l|*tO0.-1 

SA.KSuMILXAA.r.L.l.bOL) 

SX2*XSun(lLXAA.-NL,I,N0Ll 

SaAI 11*5041 (425. *ISX2-SX..7/NL)/UNBSI/ NO 

PAAll|.|(AA.8.-l2*SXll/lAA*b.l|*tOO.-T 

5x*KSu~(Il.xAB.'.L,l,r,0LI 

5X2. X5vni:LA*h,-NL,l, noli 

SABI||.SCRri42S..|>A2-SX*.7/KLI/UN9Sl/Ne 

PA6 I  I  I *PAP  t  I  l-PAA (  I  I 

SX.XSU'' (  I  HAT  ,NL  ,  I  ,NDL  I 

5X2. pSUNiILXaT.-NL.I, NOLI 

Sa1(||.S0RTI|54.25.ISX2-Sx**2/NLI /UNPSI /NU 
PATIi|.(PAP(II«PAA||>>/2. 

G5X*Q . 

05X2.0. 

NhU«nji  Z 

tFI45PK.E0.0l  nH6...a 

00  2  1*1. NL 

SX.0.0 

5X2*0. C 

S2A-0.0 

SZX2.C.0 

X8.94.r 

IF  I  JSPK  .r.E  .01  aB*J5PX«9*.o 

00  to  <4*1  ,NHO 
SX*SX. ILXQl I ,KSI 
SX2.SX7* IL.ai I .KQI .*2 

S2X.S2>*l(A6-2.0*tLXQ(t,KO|l/XBI*tOO.O 

SZX2.S7X2.|I|2P-2.:.1LXOI|.K8II/XH|.|00«OI..2 

B5X.(|;.a*9«.Or’l2.Sll)/(NQ*94.l|*100.-T 

ObXZ.GSlZ.PSI^.Z 

G5X.bSX.BSx 

ScL(|l*5w41lAdSI l5ZX2>SZX.*2/NHai/INHQ*(NHe-l III  I 

SIOl.SaKliABSI IGSx2-GSx**2/NLl/INL.(SL-| 1111  • 

ptqt.gsx/nl 

DO  5  K* I  .9 
00  5  J*l .2 
00  9  1*1.9 
SPO IK . J . 11*0.0 
SP02( K . J. 11*0.0 
00  3  L* I .NL 

SPOIK ,J. I LSPOIK , J, 1 |. ISPLI (K .L. J. 1  I 
SP02IK.J.|l*SP02IK.J,l|.t5PLTIK.L.J.ll**2 

SP02(K  ,  J.  I  l•^.•50><T  1.25..  ISP02  (K  .J.II-5PO<K.j.II*.2/NLl/U.4HS|/N« 

If It.E 1.91  SP02(K.4.I l■5Pn2IK.J.tl/2. 

SPOIK . J. 1 1*1 AA.9.-7..SP0IK .J. 1  I l/( AA*9. |.iaO..T 

SPOlK . J.3I.SP0IK.J. I I-SPOIK.J.71 

SPOIK . J.9 I.ISPOIK. J. 1 I.SPOIK. J,2I 1/2.0 

CONI INlE 

00  7  1*1.8 

Sx.0.0 

Sa2*0.C 

00  4  J.  1  ,t.L 

SX*SX. I  LX  V  I J. 1  I 

5a2*si/.|LI.(j>II..2 

5vltl«SU9TI27e.SS3.*l5X2-Sl*.2/NLI  /U‘lBS  l/t.O 

PvI1I.|I*A.|2.O-I2.S>II/IA**i2.OII.|0O.0.T 

NLTUO-) 

III  .SL 

NW*NXJ*‘iL.(J*Vt/J5P.I 

NL*J5P.  . 

JSPK.  I  TE 
GO  10  9 
LNU 


I  • 

2» 

3* 

<*• 

!>• 

*• 

7* 

B* 

10« 

I  !• 

12* 

13* 

M* 

15«  1 

!*• 

17*  2 

!*• 

20* 

2I« 

22* 

23*  3 

2‘l* 

2!»». 

2«* 

27« 

2S« 

27. 

30* 

3»« 

32* 

33» 

3‘<* 

3S* 

3B« 

37» 

38« 

39« 

**0» 

•tl# 

HZ* 

h3* 

HH* 

Hi*  H 
Hh* 

h7* 

HB* 

H9* 

SO* 

SI* 

S2* 

S3*  S 

SS*  B 

55*  7 

56* 

57*  C 
58*  C 
59*  e 
60*  9 

6l*  10 

62* 

*3*  II 
69*  12 

65* 

66*  13 

67*  19 

6B* 

69*  IS 
70* 

71* 

72*  16 

73* 

79*  17 

7S*  m 
76*  19 

77*  70 

78.  71 

79*  72 

80*  23 

8  I  •  79 

82* 


SuitROUT  IM  TTST  1  1  *2 

INTLGL^  Coot 

cot  i-.ON/iLL/CCLF  (  ISC'  1  ,Sf  L  (  2t  I  .  NO  # 'It  t •  N  V  .  jlltST  t  nOL  ,  N*5C  Cm  ,  JH  ur.L  • 

1 >Nh, t lUlG. JSP6. loCll0l.lS«Vtl20ci<NATtl2ul 
CO^hON  *'*P|7».S*PI7l,8**C7ltS**<7l,H»b(71,S*0»7),P»|(71iS* 

1 T  17 )  ,PV 18  I  .SVlPl.PTOT.STOT.RATttlCl ,SER*Tl | lU I ,5P0 I lU ,  2,9  1 ,SP02 ( 
2|0i2i9)  ■ 

OlPtNStON  SlGIS.SI 
01  -Nfl  *0 
HOr»li(L-l 


00  1  1*1 iN* 

PAP  I  I laABSIPAPl 1 I/SAPII  I  I 


PAA(n*ABS(P*A|t)/SA*(ll) 

PABI 1 laABSIPAEI I  1/5691  1  I  I 
P6T< I laAbSIPAT ( I ) /$ATI 1  I  I 
00  2  laltNV 
Py I  1  1*685(8*1 1  I /SV  I  I  )  I 
PT0T*6e5(PT0T/S70T) 

00  3  1*1, N6 

SlGI 1 ,1 l*S6Nr (PAPI t 1 .OFl 
SIGI2. I I-5GNF (PAA I  I  I ,CF ) 

Sl6l3t I l-SCNF IPAB { 1 1 ,0F I 
516(9 . 1 laSGUF (PAT  I  1  I ,UF ) 

516ToT*SGNF (PTOT .OF  1 

PRINT  15,  (COOC ( I  I • (at tN0,9 I 

PRINT  16 

PRINT  |7,  PaP( llt51GII<II.PAAl|liSI6l2.l) .PA8I ll•5IG(3.ll•PAT(|l,S 


116(9,11 

PRINT  |8.  PAPl7l,SlG(l«2>.PA*(2)>5tG(2,2l ,PAb(2i ■5lbl3,2l.PATI2l,S 
116(9,21 

PRINT  19,  PAPlTl.S16(l,3l,PA*(3),SIG(2.3lfP*3<3)iS|6l3i3)>P*Tl3),5 
116(9,31 

print  20,  PAP (*1,516(1, 91, PAAI*l,SIG(7,9l,PAB (91. 516(3. 91, PATl9l>S 
116(9,91 

PRINT  21,  PAP(Sl.51Gll.5I.PAAlSI,SlG(2.5I.PAb<5l.5|6(3.5I.PATISI,S 
116(9,51 

print  22,  PAPlsI, 516(1, 6l.PAAlAl,SlG(2.6ltP88l6l>5|6(3, 61. PATI6I.3 
116(9,61 

print  23.  PAP(7I. 516(1,71, PA Al7l,SlGl2. 71, PAol71. 516(3, 71, PATI7I.S 

116(9,71 

IF  (KR.ta.OI  GO  TO  7 

DO  9  Kal.NR 


RATt(K|aAB5(PATE(K|/SeRATE(R)l 
S£KATe(K|aS6NF (KATe(KI ,0F| 

CONTINUE 
PRINT  9 

PRINT  10,  RATE ( I  1 .SERATe ( 1  I 

PRINT  11,  RATE (21 .SERATE (2  I 

print  12.  RATEI3I ,SERATE(3I .PT0T.5IGT0T 

PRINT  13,  RATE (9  I .SENATE (9 1 

print  19,  RATElSI ,SCRATE(SI 

IF  (NR-51  6.6,5 

PRINT  a*  RATeI6I .SLRATEI6I 

return 

print  29,  PTOT.SIGTOT 

return 


FOKHaT  (SX, 15HS900THNE5S  ,F6«2,2a.A6I 

FoRHAT  (5a ,30P3UALITr  RAT|r6S  T  ) 

format  (SX , IshlOUOnESS  .F6*2 ,2a .A6 , 16m ,95hXAAAAXXXaXXXaXX ai a 

IXXXXXXXXXXXXXIXAXXAXXXXAAXXl 

FORMAT  (Sa,  ISM  JASS  CSS  ,  F 6 . 2 . 2 »  , t 6 , 1 6 A  ,  1 M A  , 9 3 a  , 1 H X ) 

FORHat  (Sx , I5HPLEASENTNE55  ,F 6  •  2 , 2 1 , A 6 , 1 6X , | HX , 9 x , I SMTO T AL  OrT  S 

ICORE .9X  aF6.2 ,9X , A6 iRX , |HX I 

FuRRaT  ( 5x , IShCLE AR 1 TT  •F6,2 a2x , A6 , I 6X , I  MX ,93X , I HX I 

format  (SA.ISM'I  at UN ALNESS  ,r6,2,2X,A6,l6X,9SHXAXAXXXAAAXXxXXAAX 

IXAXXXXXXXXAIXXIXXAXXXXXXXkI 

format  IIH1,7A,89MT  TEST — A  TEST  FOR  SIGNIFICANCE  oP  DIFFERENCES  8 
IETmEFN  diagnostic  RMTPE  test  SCORES, a/8X ,29MEXPER|mENTAL  CONqITION 
2S:,10(2X,a9|//| 

format  ( ImO,9A ,9hATTR leUTf ,7x .7MPRESENT ,12X,*hAB5ENT,I9X,9hBiAS,i5 

IXa9HMEAN| 

Format  (IH0,9x.12h,0ICIn6  ,9X,9IF6.2.2XaA6,5xll 

format  ( IMD ,*X  ,  12MNASAL n Y  ,9X ,9 IF6.7 .2X  ,A6  ,SX  I 
format  ( |m0,9a , 12hsUSTEnT  icn  ,9X ,9 ( r 6 ,2 , 2X  ,  a6  ,Sa > ; 

FORMAT  I  1 HG ,9,  I  I 2mS 1 b I  LA T  I  ON  , 9 X , 9 ( F 6 . 2 , 2  A  , A6 , 5 A  I  I 
format  (  lhO,9ji,  I7M6NAvt'  ess  ,9X  ,9  (,  6,7 ,7,  ,a6  ,Sa  1  : 
format  ( I  ho ,9  a , I 2MC0PPAC ToESs  , 9 X , 9 ( r 6 , 7 , 7X . A6  ,  S a  1 
FummaT  llHn.9,.l7HriPtPI''ENTAl..9X,9lr6.7,2X,A6,Sxl 

Format  ( //// ,'.sa  ,  ishtot al  ort  score >9x  ,f6«2,9x  ,A6  i 

I  NO 


1  • 
2« 
J* 

••• 

b* 
6  « 
7* 
8* 
9* 
lO. 
>  >• 
J2» 
13* 
1 

lb. 

|8« 

13. 

18. 

19. 

20. 
21. 
22. 
23. 
29. 


!• 

2* 

3. 

9* 

s* 

6. 

7. 

8. 

9. 

10. 
1  1* 
12. 
13. 
19. 
lb. 
16. 
17. 
|8. 

19. 

20. 
21* 
22. 
23. 
29. 
2b. 
26» 

27. 

28. 

29. 

30. 

31. 

32. 

33. 
39. 
3b. 
38. 

37. 

38. 

39. 
9U. 
9  1  . 

92. 

93. 
99. 
9b. 

96. 

97. 
9b. 
99. 
bO. 
b  1. 
b2. 
b3. 
b9. 


1 


C 

C 

2 

3 

9 

b 


SUbMOU ’ 
iNTtOf' 

C0"90i./ 
1 IXW, JA . 

CUflMON 

Cobro:* 

1  T I  7  I .p. 
210.2,91 
PO'-Cb  b 
Punch  2 
Put.CM  J 

Punch  3 

PUNCH  3 

00  1  |. 

PUNCH  9 
«2I I.I  ,j 
PC  turn 


INC  PUNCH 

CU?C  114 

»LU/CCDf  1  IbCl  .SEL12PI  .>*a.NL,N4,SV,j7T£iT,Nl.L.96bC09,JPuNC.. 
t.lcIo.ubPN.luPtlOl. t b«VI 200  I ,N8T1 120  I 
/.*F/  L*  uLllJl.lTbT 

/SCOPE/  ►•6PI71 .S*P(7).P«*«7),SA*(7) .PaBI71,5AB|7),P*T,7,  c* 
181 ,SV(A I ,PtOT .STcT.PATtl 101 .bCPATLllU) .bPOllO,  2,9| ,SP02( 

,  COOP  I  9  I .Ni.NL.NA .Nv .NO.L*aLE< 121 .LAsCt I  13  I 

•  IP*8;jI,J.1.7I,IPat(1IiIh1,7I 
.  ISAE I J) ,U.l ,7  I  ,  IbAl ( I  I , I>1 .71 
.  <SAP(  Jl  ,  J.  I  ,7  I  ,  ISaA(  I  I  .  1-1  ,7  I 

•  tPATLI  1  I  ,1-1 ,NR| ,(SEMaTEIJI,J-1,NP| .PTOT.STOT 
I  .9,2 

.  ltSPO(l.J,KI,SP02l|,J,K).J-|,2l , a«3 ,9 ).<(SHO(1.i,j,k).nhO 

,*• ,J.l .21 .K.3,9l 


FOKHaT  I 7F6. 1 . 7Fb. 1 1 
FOHHaT  l|9rb.2) 

format  I81FS. 1  ,Fb. 2M 

format  (A9,bl2,2A6| 
EnO 


99 


1 


10 
1  1 

2 


20 
2  1 

3 


30 

31 


Function  5oha2c'',m 

COMMON  /AUO/  SUM(20.2t2.2.2.7>.K(l0l 
DIMENSION  SMl2C.2.2,2.2,2l,Nlln) 

«l«K(  1  1 
K2bA(2I 
K3-K I  3  I 
K9.AI91 
Kb-A(SI 
K6«K ( 6  I 
00  99  I  1 . 1  .A  1 
00  99  I  2-1 ,K2 
00  99  1 3- 1  ,K3 
00  99  I  9. 1 , A9 
00  99  lb-1. Kb 
00  99  16-1, A6 

SMI  1 1 . I  2 , 13. 19 . Ib. |6 l-SUH(  II, 12, 13,19, IS. 16) 
IFIM.e'S.C*  go  to  101 

00  100  1-1, M 

NN-r.  1 1 1 

Nl I  1-0 

GO  To  II .2,3,9,b,6l .NN 

DO  11  I2-1,K2 

00  II  13-1, K3 

00  11  19-1, K9 

00  11  IV>.l,Kb 

00  11  |6.1,K6 

Sa-O, 

00  10  11.1,A1 

SA>S>.SM(|t,|2,l3.I9,lb.I6) 

SHII|,l2,I3,|9,tb.|6)-0, 

>MI 1 , 12 , 13. 19 . Ib. l6 l-SA 

GO  To  1 uG 

00  21  I  1 ■ 1 ,K I 

00  2l  I3«l  ,«3 

00  21  I  9. I  ,  A9 

00  2l  ib.l.KS 

00  2l  lA-l  ,A6 

bA-0. 

DO  20  12-1 ,K2 

SA-SI. $9111,12,13. 19, lb, 161 

SMIIi,I2.l3.I9.Ib.l6l -0. 

bH( I  I . I  ,  13,  I9 , Ib , Ibl-SX 

60  TO  100 

00  3|  I  1  •  1  .F  I 

DU  3l  12*1 ,K2 

DO  3l  I  9. 1 ,K9 

00  3|  Ib-l .AS 

CO  3  I  ! &• I , A6 

b  A  *0  . 

DU  30  I3«1,A3 

$A.$i«$.'ili|,i2,!3,l9,lb,i6) 

5"l  I  1  ,  I  7, 1 3 . I  9 , 1$ , I* ) .0, 

SMI  I  I . I  2. 1 , I  9 . I N , U i.bl 
GO  TO  100 
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s'-* 

•« 

Oa  9  1  1  1  •  1  ,ici 

s*  • 

OU  9 1  1 7* 1 ,K  7 

s;» 

CO  9 1  I  3*  J ,<3 

Se  • 

UO  9  j  1 S> 1 ,KS 

S9» 

00  9|  |6*| ,K6 

«0* 

Sl*0< 

6  1  • 

00  9C  |9*|,K9 

62* 

Si*Sl*3*'l  tl.l2.l3>19,IS.l6) 

63* 

90 

Sni  1 1  .  12 , 1 3t 1 9 • IS • t6>*b« 

b*** 

9J 

Sal  1  1  ,  1  2  .  I  3 • 1 . IS • 16  >«SX 

6S* 

GO  TO  ICC 

b6« 

s 

Du  S 1  1  I ■ I  iK  I 

67* 

00  5l  :2»t ,K7 

&«>• 

00  S|  13*1 ,K3 

69* 

00  SI  19*  j  ,ni4 

7U» 

DO  Si  16*1  ,IC6 

71* 

S»«0. 

72* 

00  so  :s*i  ,Ks 

73* 

S**Sx*S9(ti,|2,I3iI9,|S.|6) 

7‘t* 

so 

S»<I  1  1  ,  12, 13.  |9.  ISi  t6l*0< 

7S» 

SI 

SHI  1  1 . 1 2 1 1 3 • 1 9  1 1 ■ 16>>SX 

/6« 

GO  TO  IOC 

77* 

6 

00  61  I  1*1  ,K| 

78* 

00  61  12*1 ,22 

79. 

00  61  1  3*1  ,23 

6C* 

00  61  19*1 ,29 

8  1  • 

00  6|  iS«l  ,2S 

92* 

SX*0. 

83* 

00  60  16*1 ,26 

as* 

SX*SX*S‘'l|l.l2.t3.|9,tS.|6l 

as* 

60 

Sni 1 1 , I  2 , 1 3 , 19  .  IS , !& 1*0, 

P6* 

6  1 

SHI  1  1  ,  12, 1 3, 19  ,  IS. 1  l*SX 

c  7* 

IU3 

CONT  IN  jF. 

68* 

101 

SOHX2-0* 

89* 

00  111  11*1,21 

90* 

00  HI  12*1,22 

9  1  • 

00  111  13*1 ,23 

92* 

00  III  19*1,29 

93* 

DO  III  IS*1 ,2S 

99* 

00  111  16*1,26 

VS* 

1  1  1 

SU*'X2*'.uilx2*S7' 1  11.12.13,19, 

96* 

hftorn 

97* 

CNO 

APPENDIX  II 


SPECIMEN  DRT  IV  ANSWER  BOOKLET 


DRT  IV- (1) 
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A 


BOB  -  GOB 
DAUNT  -  TAUNT 
MDOT  -  BOOT 
SHEET  -  CHEAT 
GAB  -  JAB 
TOT  -  POT 
BOAST  -  GHOST 
RIP  -  LIP 
SAID  -  ZED 
GNAW  -  DAW 
SHOES  -  CHOOSE 
KEEP  -  CHEEP 
DANK  -  BANK 
DOT  -  GOT 

O  road  -  LOAD 

TINT  -  DINT 
DECK  -  NECK 
TONG  -  THONG 
CHEW  -  COO 
REED  -  WEED 
SAG  -  SHAG 
LOT  -  ROT 
FOAL  -  VOLE 
DIP  -  NIP 
raCE  -  PENCE 
rriAW  -  SAW 
POOL  -  TOOL 
YIELD  -  WIELD 
LAP  -  RAP 


COOT  -  TOOT 
POND  -  BOND 
BONE  -  MOAN 
BILL  -  VILL 
GUEST  -  JEST 
FOUGHT  -  THOUGHT 
POOP  -  COOP 
LEAP  -  REAP 
FAST  -  VAST 
KNOCK  -  DOCK 
DOZE  -  THOSE 
SING  -  THING 
NET  -  MET 
CAUGHT  -  TAUGHT 

I£WD  -  RUDE  O 

BEAN  -  PEEN 
MAD  -  BAD 
BOX  -  VOX 
JOE  -  GO 
DID  -  BID 
WREN  -  YEN 
LAW  -  RAW 
ZOO  -  SUE 
NEED  -  DEED 
THAN  -  DAN 
CHOP  -  COP 
FORE  -  THOR 
FIT  -  HIT 
LEST  -  REST 


NAME 


DATE 


DRT  IV- (1) 
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B 


PEST  -  TEST 
FAULT  -  VAULT 
NEWS  -  DUES 
VEE  -  BEE 
THANK  -  SANK 
WAD  -  ROD 
SO  -  SHOW 
RID  -  LID 
DENSE  -  TENSE 
BOSS  -  MOSS 
FOO  -  POOH 
THEE  -  ZEE 
FAD  -  THAD 
FOP  -  HOP 
O  ROW  -  LOW 

GIN  -  CHIN 
BEND  -  MEND 
SHAW  -  CHAW 
GOOSE  -  JUICE 
PEAK  -  TEAK 
GAT  -  BAT 
ROCK  -  LOCK 
COAT  -  GOAT 
BIT  -  MIT 
DEN  -  THEN 
JAWS  -  GAUZE 
MOON  -  NOON 
TEA  -  KEY 
RAMP  -  LAMP 


FAN  -  PAN 
CHOCK  -  JOCK 
NOTE  -  DOTE 
THICK  -  TICK 
CHAIR  -  CARE 
DONG  -  BONG 
RUE  -  YOU 
REEK  -  LEAK 
GAFF  -  CALF 
MOM  -  BOMB 
DOUGH  -  THOUGH 
GILT  -  JILT 
TENT  -  PENT 
YAWL  -  WALL 
ROOT  -  LOOT  O 

FEEL  -  VEAL 
NAB  -  DAB 
BON  -  VON 
THOLE  -  SOLE 
THIN  -  FIN 
KEG  -  PEG 
WRONG  -  LONG 
TUNE  -  DUNE 
BEAT  -  MEAT 
CHAD  -  SHAD 
JOT  -  GOT 
BOWL  -  DOLE 
GILL  -  DILL 
REND  -  LEND 


DRT  IV- (1) 
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C 


GOB  -  BOB 
TAUNT  -  DAUNT 
MOOT  -  BOOT 
SHEET  -  CHEAT 
GAB  -  JAB 
TOT  -  POT 
BOAST  -  GHOST 
RIP  -  LIP 
SAID  -  ZED 
DAW  -  GNAW 
SHOES  -  CHOOSE 
KEEP  -  CHEEP 
DANK  -  BANK 
DOT  -  GOT 

O  road  -  LOAD 

TINT  -  DINT 
DECK  -  NECK 
THONG  -  TONG 
CHEW  -  COO 
WEED  -  REED 
SAG  -  SHAG 
LOT  -  ROT 
FOAL  -  VOLE 
DIP  -  NIP 
FENCE  -  PENCE 
SAW  -  THAW 
POOL  -  TOOL 
WIELD  -  YIELD 
LAP  -  RAP 


COOT  -  TOOT 
POND  -  BOND 
BONE  -  MOAN 
BILL  -  VI LL 
GUEST  -  JEST 
THOUGHT  -  FOUGHT 
POOP  -  COOP 
REAP  -  LEAP 
VAST  -  FAST 
KNOCK  -  DOCK 
DOZE  -  THOSE 
SING  -  THING 
NET  -  MET 
CAUGHT  -  TAUGHT 

LEWD  -  RUDE  Q 

PEEN  -  BEAN 
MAD  -  BAD 
BOX  -  VOX 
JOE  -  GO 
DID  -  BID 
WREN  -  YEN 
LAW  -  RAW 
SUE  -  ZOO 
DEED  -  NEED 
DAN  -  THAN 
CHOP  -  COP 
FORE  -  THOR 
FIT  -  HIT 
REST  -  LEST 


DRT  IV- (1) 
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D 


TEST  -  PEST 
VAULT  -  FAULT 
NEWS  -  DUES 
VEE  -  BEE 
THANK  -  SANK 
WAD  -  ROD 
SO  -  SHOW 
RID  -  LID 
DENSE  -  TENSE 
MOSS  -  BOSS 
FOO  -  POOH 
THEE  -  ZEE 
FAD  -  THAD 
FOP  -  HOP 
O  ROW  -  LOW 

GIN  -  CHIN 
BEND  -  MEND 
CHAW  -  SHAW 
GOOSE  -  JUICE 
TEAK  -  PEAK 
GAT  -  BAT 
ROCK  -  LOCK 
COAT  -  GOAT 
BIT  -  MIT 
DEN  -  THEN 
GAUZE  -  JAWS 
MOON  -  NOON 
KEY  -  TEA 
RAMP  -  LAMP 


FAN  -  PAN 
CHOCK  -  JOCK 
NOTE  -  DOTE 
THICK  -  TICK 
CHAIR  -  CARE 
BONG  -  DONG 
RUE  -  YOU 
LEAK  -  REEK 
CALF  -  GAFF 
MOM  -  BOMB 
DOUGH  -  THOUGH 
GILT  -  JILT 
TENT  -  PENT 
YAWL  -  WALL 
ROOT  -  LOOT  O 

VEAL  -  FEEL 
NAB  -  DAB 
BON  -  VON 
THOLE  -  SOLE 
THIN  -  FIN 
KEG  -  PEG 
WRONG  -  LONG 
DUNE  -  TUNE 
MEAT  -  BEAT 
SHAD  -  CHAD 
JOT  -  GOT 
BOWL  -  DOLE 
GILL  -  DILL 
LEND  -  REND 


DRT  IV- (1) 
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E 


GOB  -  BOB 
TAUNT  -  DAUNT 
MOOT  -  BOOT 
SHEET  -  CHEAT 
JAB  -  GAB 
POT  -  TOT 
BOAST  -  GHOST 
RIP  -  LIP 
SAID  -  ZED 
DAW  -  GNAW 
SHOES  -  CHOOSE 
CHEEP  -  KEEP 
BANK  -  DANK 
GOT  -  DOT 

O  load  -  ROAD 

DINT  -  TINT 
DECK  -  NECK 
THONG  -  TONG 
CHEW  -  COO 
WEED  -  REED 
SAG  -  SHAG 
LOT  -  ROT 
VOUE  -  FOAL 
NIP  -  DIP 
FENCE  -  PENCE 
SAW  -  THAW 
POOL  -  TOOL 
WIELD  -  YIELD 
LAP  -  RAP 


TOOT  -  COOT 
BOND  -  POND 
MOAN  -  BONE 
VILL  -  BILL 
GUEST  -  JEST 
THOUGHT  -  FOUGHT 
COOP  -  POOP 
REAP  -  LEAP 
VAST  -  FAST 
DOCK  -  KNOCK 
DOZE  -  THOSE 
THING  -  SING 
NET  -  MET 
TAUGHT  -  CAUGHT 

LEWD  -  RUDE  Q 

PEEN  -  BEAN 
MAD  -  BAD 
BOX  -  VOX 
GO  -  JOE 
DID  -  BID 
WREN  -  YEN 
LAW  -  RAW 
SUE  -  ZOO 
DEED  -  NEED 
DAN  -  THAN 
COP  -  CHOP 
FORE  -  THOR 
FIT  -  HIT 
REST  -  LEST 


DRT  IV- (1) 
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TEST 

- 

PEST 

FAN 

- 

PAN 

VAULT 

- 

FAULT 

CHOCK 

- 

JOCK 

NEWS 

- 

DUES 

NOTE 

- 

DOTE 

VEE 

- 

BEE 

TICK 

- 

THICK 

THANK 

- 

SANK 

CHAIR 

m 

CARE 

WAD 

- 

ROD 

BONG 

- 

DONG 

SO 

- 

SHOW 

YOU 

- 

RUE 

RID 

- 

LID 

LEAK 

- 

REEK 

TENSE 

- 

DENSE 

CALF 

- 

GAFF 

MOSS 

- 

BOSS 

BOMB 

- 

MOM 

POOH 

- 

FOO 

DOUGH 

- 

THOUGH 

THEE 

- 

ZEE 

GILT 

- 

JILT 

FAD 

- 

THAD 

TENT 

- 

PENT 

FOP 

- 

HOP 

YAWL 

- 

WALL 

LOW 

- 

ROW 

LOOT 

- 

ROOT 

GIN 

- 

CHIN 

VEAL 

- 

FEEL 

MEND 

- 

BEND 

DAB 

- 

NAB 

CHAW 

- 

SHAW 

VON 

- 

BON 

GOOSE 

- 

JUICE 

SOLE 

- 

THOLE 

TEAK 

- 

PEAK 

FIN 

- 

THIN 

BAT 

- 

GAT 

KEG 

- 

PEG 

LOCK 

- 

ROCK 

LONG 

- 

WRONG 

GOAT 

- 

COAT 

DUNE 

- 

TUNE 

BIT 

- 

MIT 

MEAT 

- 

BEAT 

DEN 

THEN 

SHAD 

- 

CHAD 

GAUZE 

m 

JAWS 

JOT 

- 

GOT 

NOON 

- 

MOON 

DOLE 

- 

BOWL 

KEY 

- 

TEA 

DILL 

- 

GILL 

LAMP 

- 

RAMP 

LEND 

— 

REND 

DRT  IV- (1) 
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G 


BOB  -  GOB 
DAUNT  -  TAUNT 
HX)T  -  BOOT 
SHEET  -  CHEAT 
JAB  -  GAB 
POT  -  TOT 
BOAST  -  GHOST 
RIP  -  LIP 
SAID  -  ZED 
GNAW  -  DAW 
SHOES  -  CHOOSE 
CHEEP  -  KEEP 
BANK  -  DANK 
GOT  -  DOT 

O  I^AD  -  ROAD 

DINT  -  TINT 
DECK  -  NECK 
TONG  -  THONG 
CHEW  -  COO 
REED  -  WEED 
SAG  -  SHAG 
LOT  -  ROT 
VOLE  -  FOAL 
NIP  -  DIP 
FENCE  -  PENCE 
THAW  -  SAW 
POOL  -  TOOL 
YIELD  -  WIELD 
LAP  -  RAP 


TOOT  -  COOT 
BOND  -  POND 
MOAN  -  BONE 
VILL  -  BILL 
GUEST  -  JEST 
FOUGHT  -  THOUGHT 
COOP  -  POOP 
LEAP  -  REAP 
FAST  -  VAST 
DOCK  -  KNOCK 
DOZE  -  THOSE 
THING  -  SING 
NET  -  MET 
TAUGHT  -  CAUGHT 

LEWD  -  RUDE  Q 

BEAN  -  PEEN 
MAD  -  BAD 
BOX  -  VOX 
GO  -  JOE 
DID  -  BID 
WREN  -  YEN 
LAW  -  RAW 
ZOO  -  SUE 
NEED  -  DEED 
THAN  -  DAN 
COP  -  CHOP 
FORE  -  THOR 
FIT  -  HIT 
LEST  -  REST 


DRT  IV- (1) 
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H 


PEST  -  TEST 
FAULT  -  VAULT 
NEWS  -  DUES 
VEE  -  BEE 
THANK  -  SANK 
WAD  -  ROD 
SO  -  SHOW 
RID  -  LID 
TENSE  -  DENSE 
BOSS  -  MOSS 
POOH  -  FOO 
THEE  -  ZEE 
FAD  -  THAD 
FOP  -  HOP 
O  LOW  -  ROW 

GIN  -  CHIN 
MEND  -  BEND 
SHAW  -  CHAW 
GOOSE  -  JUICE 
PEAK  -  TEAK 
BAT  -  GAT 
LOCK  -  ROCK 
GOAT  -  COAT 
BIT  -  MIT 
DEN  -  THEN 
JAWS  -  GAUZE 
NOON  -  MOON 
TEA  -  KEY 
LAMP  -  RAMP 


FAN  -  PAN 
CHOCK  -  JOCK 
NOTE  -  DOTE 
TICK  -  THICK 
CHAIR  -  CARE 
DONG  -  BONG 
YOU  -  RUE 
REEK  -  LEAK 
GAFF  -  CALF 
BOMB  -  MOM 
DOUGH  -  THOUGH 
GILT  -  JILT 
TENT  -  PENT 
YAWL  -  WALL 
LOOT  -  ROOT  O 

FEEL  -  VEAL 
DAB  -  NAB 
VON  -  BON 
SOLE  -  THOLE 
FIN  -  THIN 
KEG  -  PEG 
LONG  -  WRONG 
TUNE  -  DUNE 
BEAT  -  MEAT 
CHAD  -  SHAD 
JOT  -  GOT 
DOLE  -  BOWL 
DILL  -  GILL 
REND  -  LEND 


APPENDIX  III 

SPECIMEN  OUTPUT  OF  DRT  IV 
COMPUTER  SCORING  PROGRAM 
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